Add RMM User Guide #2087
Add RMM User Guide #2087
Conversation
|
Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually. Contributors can view more details about this message here. |
| Use NVIDIA Nsight Systems to visualize page faults and data migration: | ||
|
|
||
| ```bash | ||
| nsys profile -o output python your_script.py |
There was a problem hiding this comment.
Need to specify:
--cuda-um-cpu-page-faults=true --cuda-um-gpu-page-faults=true
At least the GPU one. I haven't tried omitting the CPU one to see if it is needed.
| ```python | ||
| import rmm | ||
|
|
||
| rmm.mr.set_current_device_resource(rmm.mr.ManagedMemoryResource()) |
There was a problem hiding this comment.
I'm hesitant to include this because people will copy pasta and see the poor performance that usually causes people to reject managed memory.
| - Configurable initial and maximum pool sizes | ||
|
|
||
| **Disadvantages:** | ||
| - Can suffer from fragmentation (unlike async MR) |
There was a problem hiding this comment.
Especially in multi-stream workloads. Single-stream seems to be les impacted
|
I've broken this PR into a few parts that are ready to merge: After #2137 merges, I will start breaking up the new user guide documents into their own PRs. |
This PR improves a few small issues in the Python documentation. Split off from #2087. Authors: - Bradley Dice (https://github.com/bdice) Approvers: - Matthew Murray (https://github.com/Matt711) URL: #2139
This is split off of #2087. I am overhauling the RMM documentation. This is the first set of changes, which includes a new theme and a reorganization of the C++ docs. All docs now use Markdown / Myst. The next phases will include docstring tweaks to fix various formatting/cross-linking issues (see #2138 and #2139 for current progress on this), an expansion of the Python API docs, and adding user guides for various features. Authors: - Bradley Dice (https://github.com/bdice) Approvers: - Matthew Murray (https://github.com/Matt711) - Rong Ou (https://github.com/rongou) - Jake Awe (https://github.com/AyodeAwe) URL: #2137
This PR improves a few small issues in the C++ documentation. Split off from #2087. Authors: - Bradley Dice (https://github.com/bdice) Approvers: - David Wendt (https://github.com/davidwendt) - Nghia Truong (https://github.com/ttnghia) URL: #2138
2 participants
Description
Draft only, not ready for review.
This is a placeholder. I plan to revise this heavily and cut up the new docs into multiple PRs.
Checklist