Skip to content

Commit c8b4726

Browse files
authored
Merge pull request #223 from rollandf/nfsrdma
fix: clarify support for GDS
2 parents 7ca4e18 + 176aac8 commit c8b4726

File tree

1 file changed

+17
-4
lines changed

1 file changed

+17
-4
lines changed

docs/advanced/doca-drivers.rst

Lines changed: 17 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -37,19 +37,32 @@ The following are special environment variables supported by the NVIDIA DOCA-OFE
3737
| * ib_srpt
3838
* - ENABLE_NFSRDMA
3939
- "false"
40-
- Enable loading of NFS & NVME related storage modules from a NVIDIA DOCA-OFED Driver container
40+
- Enable loading of NFS related storage modules from a NVIDIA DOCA-OFED Driver container
4141
* - RESTORE_DRIVER_ON_POD_TERMINATION
4242
- "false"
4343
- Restore host drivers when a container
4444

4545
In addition, it is possible to specify any environment variables to be exposed to the NVIDIA DOCA-OFED Driver container, such as the standard "HTTP_PROXY", "HTTPS_PROXY", "NO_PROXY".
4646

47+
----------------------------------------
48+
CREATE_IFNAMES_UDEV Environment Variable
49+
----------------------------------------
50+
4751
.. warning::
4852
CREATE_IFNAMES_UDEV is set automatically by the Network Operator, depending on the Operating System of the worker nodes in the cluster (the cluster is assumed to be homogenous).
4953

50-
.. warning::
51-
When ENABLE_NFSRDMA is set to `true`, it is not possible to load NVME related storage modules from NVIDIA DOCA-OFED Driver container when they are in use by the system
52-
(e.g the system has NVMe SSD drives in use). User should ensure the modules are not in use and blacklist them prior to the use of NVIDIA DOCA-OFED Driver container.
54+
-----------------------------------
55+
ENABLE_NFSRDMA Environment Variable
56+
-----------------------------------
57+
58+
In context of GPU Direct Storage (GDS) feature, only GDS with NFS over RDMA is supported.
59+
In this case, NVME over RDMA cannot be used. It is not possible to load inbox modules since they depend on `ib_core` which does not match (symbol error). Only NVME with local drive is supported.
60+
61+
62+
63+
---------------------------
64+
Example of NicClusterPolicy
65+
---------------------------
5366

5467
These variables can be set in the NicClusterPolicy. For example:
5568

0 commit comments

Comments
 (0)