We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 8e7e6eb commit 64be2f0Copy full SHA for 64be2f0
README.md
@@ -20,6 +20,7 @@ Fundamental research to develop new architectures for foundation models and A(G)
20
21
## News
22
23
+- December, 2023: [LongNet](torchscale/model/LongNet.py) and [LongViT](examples/longvit/README.md) released
24
- October, 2023: Update RMSNorm and SwiGLU as the default module in RetNet
25
- November, 2022: TorchScale 0.1.1 released [[Paper](https://arxiv.org/abs/2211.13184)] [[PyPI](https://pypi.org/project/torchscale/)]
26
@@ -142,6 +143,8 @@ We have examples of how to use TorchScale in the following scenarios/tasks:
142
143
144
- Vision
145
146
+ * [LongViT](examples/longvit/README.md)
147
+
148
* ViT/BEiT [In progress]
149
150
- Speech
0 commit comments