You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: conf.py
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -195,7 +195,7 @@
195
195
196
196
#top_banner_message="<span>⚠</span><a class='reference internal' style='color:white;' href='https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/setup/setup-troubleshooting.html#gpg-key-update'> Neuron repository GPG key for Ubuntu installation has expired, see instructions how to update! </a>"
197
197
198
-
top_banner_message="Neuron 2.21.0 Beta is released! check <a class='reference internal' style='color:white;' href='https://awsdocs-neuron.readthedocs-hosted.com/en/latest/release-notes/index.html#latest-neuron-release'> What's New </a> and <a class='reference internal' style='color:white;' href='https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/announcements/index.html'> Announcements </a>"
198
+
top_banner_message="Neuron 2.21.0 is released! check <a class='reference internal' style='color:white;' href='https://awsdocs-neuron.readthedocs-hosted.com/en/latest/release-notes/index.html#latest-neuron-release'> What's New </a> and <a class='reference internal' style='color:white;' href='https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/announcements/index.html'> Announcements </a>"
Copy file name to clipboardExpand all lines: containers/tutorials/k8s-prerequisite.rst
+17Lines changed: 17 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -44,6 +44,23 @@ This template file has a few important config settings -
44
44
* The template installs the EFA driver. Please note that the libfabric version should match between the AMI and the workload containers.
45
45
* It uses the `EKS optimized accelerated AMI <https://docs.aws.amazon.com/eks/latest/userguide/eks-optimized-ami.html#gpu-ami>`__ which has the necessary neuron components installed. The template uses AMI for Kubernetes version 1.25. Please update to appropriate version.
46
46
* The template adds trn1.32xlarge nodes to the cluster. Please update to the desired instance type.
47
+
* Trn2 instance types use a default LNC (Logical NeuronCore Configuration) setting of `2`, if you want to change it to `1`, update the UserData section of the launch template to a new LNC setting as shown below, and deploy the new/updated version of launch template.
Copy file name to clipboardExpand all lines: dlami/index.rst
+52-86Lines changed: 52 additions & 86 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -17,8 +17,8 @@ to easily get started on single Neuron instance. Below sections describe the sup
17
17
18
18
Neuron Multi Framework DLAMI
19
19
----------------------------
20
-
Neuron Deep Learning AMI (DLAMI) is a multi-framework DLAMI that supports multiple Neuron framework/libraries. Each DLAMI is pre-installed with Neuron drivers and support all Neuron instance types. Each virtual environment that corresponds to a specific Neuron framework/library
21
-
comes pre-installed with all the Neuron libraries including Neuron compiler and Neuron run-time needed for you to easily get started.
20
+
Neuron Deep Learning AMI (DLAMI) is a multi-framework DLAMI that supports multiple Neuron framework/libraries. Each DLAMI is pre-installed with Neuron drivers and support all Neuron instance types. Each virtual environment that corresponds to a specific Neuron framework/library
21
+
comes pre-installed with all the Neuron libraries including Neuron compiler and Neuron run-time needed for you to easily get started.
22
22
23
23
24
24
Multi Framework DLAMIs supported
@@ -31,14 +31,14 @@ Multi Framework DLAMIs supported
You can easily get started with the multi-framework DLAMI through AWS console by following this :ref:`setup guide <setup-ubuntu22-multi-framework-dlami>` . If you are looking to
78
-
use the Neuron DLAMI in your cloud automation flows , Neuron also supports :ref:`SSM parameters <ssm-parameter-neuron-dlami>` to easily retrieve the latest DLAMI id.
79
-
79
+
You can easily get started with the multi-framework DLAMI through AWS console by following this :ref:`setup guide <setup-ubuntu22-multi-framework-dlami>`. If you are looking to
80
+
use the Neuron DLAMI in your cloud automation flows, Neuron also supports :ref:`SSM parameters <ssm-parameter-neuron-dlami>` to easily retrieve the latest DLAMI id.
80
81
81
82
82
83
Neuron Single Framework DLAMI
83
84
-----------------------------
84
85
85
-
Neuron supports single framework DLAMIs that correspond to a single framework version (ex:- PyTorch 1.13). Each DLAMI is pre-installed with Neuron drivers and supports all Neuron instance types. Each virtual environment corresponding to a specific
86
-
Neuron framework/library comes pre-installed with all the relevant Neuron libraries including Neuron compiler and Neuron run-time.
87
-
86
+
Neuron supports single framework DLAMIs that correspond to a single framework version (ex:- TensorFlow 2.10). Each DLAMI is pre-installed with Neuron drivers and supports all Neuron instance types. Each virtual environment corresponding to a specific
87
+
Neuron framework/library comes pre-installed with all the relevant Neuron libraries including Neuron compiler and Neuron run-time.
88
88
89
89
90
90
Single Framework DLAMIs supported
@@ -96,32 +96,19 @@ Single Framework DLAMIs supported
96
96
:class: table-smaller-font-size
97
97
98
98
* - Framework
99
-
- Operating System
99
+
- Operating System
100
100
- Neuron Instances Supported
101
101
- DLAMI Name
102
102
103
-
* - PyTorch 2.1
104
-
- Ubuntu 22.04
105
-
- Inf2, Trn1, Trn1n
106
-
- Deep Learning AMI Neuron PyTorch 2.1 (Ubuntu 22.04)
107
-
108
-
* - PyTorch 1.13
103
+
* - Tensorflow 2.10
109
104
- Ubuntu 22.04
110
-
- Inf1, Inf2, Trn1, Trn1n
111
-
- Deep Learning AMI Neuron PyTorch 1.13 (Ubuntu 22.04)
112
-
113
-
* - PyTorch 1.13
114
-
- Ubuntu 20.04
115
-
- Inf1, Inf2, Trn1, Trn1n
116
-
- Deep Learning AMI Neuron PyTorch 1.13 (Ubuntu 20.04)
105
+
- Inf1, Inf2, Trn1, Trn1n, Trn2
106
+
- Deep Learning AMI Neuron TensorFlow 2.10 (Ubuntu 22.04)
117
107
118
108
* - Tensorflow 2.10
119
109
- Ubuntu 20.04
120
-
- Inf2, Trn1, Trn1n
121
-
- Deep Learning AMI Neuron TensorFlow 2.10 (Ubuntu 20.04)
122
-
123
-
124
-
110
+
- Inf2, Trn1, Trn1n
111
+
- Deep Learning AMI Neuron TensorFlow 2.10 (Ubuntu 20.04)
* - Deep Learning AMI Neuron PyTorch 2.1 (Ubuntu 22.04)
141
-
- torch-neuronx, neuronx-distributed
142
-
- /opt/aws_neuron_venv_pytorch
143
-
144
-
* - Deep Learning AMI Neuron PyTorch 1.13 (Ubuntu 22.04)
145
-
- torch-neuronx, neuronx-distributed
146
-
- /opt/aws_neuron_venv_pytorch
147
-
148
-
* - Deep Learning AMI Neuron PyTorch 1.13 (Ubuntu 22.04)
149
-
- torch-neuron
150
-
- /opt/aws_neuron_venv_pytorch_inf1
151
-
152
-
* - Deep Learning AMI Neuron PyTorch 1.13 (Ubuntu 20.04)
153
-
- torch-neuronx, neuronx-distributed
154
-
- /opt/aws_neuron_venv_pytorch
155
-
156
-
* - Deep Learning AMI Neuron PyTorch 1.13 (Ubuntu 20.04)
157
-
- torch-neuron
158
-
- /opt/aws_neuron_venv_pytorch_inf1
159
-
160
-
* - Deep Learning AMI Neuron TensorFlow 2.10 (Ubuntu 20.04)
127
+
* - Deep Learning AMI Neuron TensorFlow 2.10 (Ubuntu 22.04)
161
128
- tensorflow-neuronx
162
-
- /opt/aws_neuron_venv_tensorflow
163
-
164
-
You can easily get started with the single framework DLAMI through AWS console by following one of the corresponding setup guides . If you are looking to
165
-
use the Neuron DLAMI in your cloud automation flows , Neuron also supports :ref:`SSM parameters <ssm-parameter-neuron-dlami>` to easily retrieve the latest DLAMI id.
129
+
- /opt/aws_neuronx_venv_tensorflow_2_10
166
130
131
+
* - Deep Learning AMI Neuron TensorFlow 2.10 (Ubuntu 20.04)
132
+
- tensorflow-neuronx
133
+
- /opt/aws_neuron_venv_tensorflow_2_10
167
134
135
+
* - Deep Learning AMI Neuron TensorFlow 2.10 (Ubuntu 22.04)
136
+
- tensorflow-neuron (Inf1)
137
+
- /opt/aws_neuron_venv_tensorflow_2_10_inf1
168
138
139
+
You can easily get started with the single framework DLAMI through AWS console by following one of the corresponding setup guides . If you are looking to
140
+
use the Neuron DLAMI in your cloud automation flows , Neuron also supports :ref:`SSM parameters <ssm-parameter-neuron-dlami>` to easily retrieve the latest DLAMI id.
169
141
170
142
Neuron Base DLAMI
171
143
-----------------
@@ -182,15 +154,15 @@ Base DLAMIs supported
182
154
:class: table-smaller-font-size
183
155
184
156
* - Operating System
185
-
- Neuron Instances Supported
157
+
- Neuron Instances Supported
186
158
- DLAMI Name
187
159
188
160
* - Ubuntu 22.04
189
-
- Inf1, Inf2, Trn1, Trn1n
161
+
- Inf1, Inf2, Trn1, Trn1n
190
162
- Deep Learning Base Neuron AMI (Ubuntu 22.04)
191
163
192
164
* - Ubuntu 20.04
193
-
- Inf1, Inf2, Trn1, Trn1n
165
+
- Inf1, Inf2, Trn1, Trn1n
194
166
- Deep Learning Base Neuron AMI (Ubuntu 20.04)
195
167
196
168
@@ -205,9 +177,9 @@ In the future releases, we will add support for finding the DLAMI id using SSM p
205
177
206
178
207
179
Finding specific DLAMI image id with the latest neuron release
@@ -307,7 +273,7 @@ Use SSM alias in EC2 launch templates
307
273
"""""""""""""""""""""""""""""""""""""
308
274
309
275
310
-
SSM Parameters can also be used directly in launch templates. So, you can update your Auto Scaling groups to use new AMI IDs without needing to create new launch templates or new versions of launch templates each time an AMI ID changes.
276
+
SSM Parameters can also be used directly in launch templates. So, you can update your Auto Scaling groups to use new AMI IDs without needing to create new launch templates or new versions of launch templates each time an AMI ID changes.
0 commit comments