You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+2-1Lines changed: 2 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5826,4 +5826,5 @@ Fixes for the following issues will be released shortly:
5826
5826
* The fine-tuning SQuAD results for T5 are lower than expected.
5827
5827
* There has been a slight regression in T5 performance and this will be addressed in an upcoming release.
5828
5828
* Evaluation for GPT has been tested for PP <=2 and may have issues for PP >2. It is recommended to convert to TP only for Evaluation.
5829
-
5829
+
* Transformer Engine (TE)-based GPT models are currently not supported for any Parameter Efficient Fine Tuning (PEFT) techniques - this will be added soon.
5830
+
* TE-based GPT Eval will take more memory than non-TE-based GPT Eval.
0 commit comments