Initial OpenFold container commit #35
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Use numpy 1.x Add libaio x86_64 and ARM64 build working Ran Inference tests on x86_64 and ARM64 Ran Training on 8 GPU DGX (x86_64) node: Completed ephoch 0 training Restarted training from epoch 0 checkpoint AOK Slurm examples for x86_64 and ARM64 NOTE: The following files have "raw" github URLs that will have to be fixed for production: BUILD-ARM64.md README.md Tony
Prevent attempting to run X86 binaries on ARM64 Tony
Avoids a "df" error when running OpenFold Tony
A GPU has to be requested with the "salloc" or the nvidia pieces, "nvcc" CUDA etc. don't get downloaded and installed. Even though "--exclusive" is used, "nvidia-smi -L" sees no GPU Tony
Build takes about 4 hours Tony
Note: ARM64 build still broken Tony
Occasionally there wil be the following error on container startup: /usr/bin/rm: cannot remove '/usr/local/cuda/compat/lib': Read-only file system rm: cannot remove '/usr/local/cuda/compat/lib': Read-only file system The nvidia continers add "--writable-tmpfs" to their containers but I can't find a way to do this in the .def file, so added to the container startup. Tony
Unfortunately here are slews of deprecation and future warnings that cannot be easily supresssed - needs code changes Tony
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Use numpy 1.x
Add libaio
x86_64 and ARM64 build working
Ran Inference tests on x86_64 and ARM64
Ran Training on 8 GPU DGX (x86_64) node:
Completed epoch 0 training
Restarted training from epoch 0 checkpoint AOK
Slurm examples for x86_64 and ARM64
NOTE: The following files have "raw" github URLs that will have to be fixed for production:
BUILD-ARM64.md
README.md
Tony