Skip to content

Commit 64be2f0

Browse files
committed
add LongNet and LongViT in README
1 parent 8e7e6eb commit 64be2f0

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

README.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,7 @@ Fundamental research to develop new architectures for foundation models and A(G)
2020

2121
## News
2222

23+
- December, 2023: [LongNet](torchscale/model/LongNet.py) and [LongViT](examples/longvit/README.md) released
2324
- October, 2023: Update RMSNorm and SwiGLU as the default module in RetNet
2425
- November, 2022: TorchScale 0.1.1 released [[Paper](https://arxiv.org/abs/2211.13184)] [[PyPI](https://pypi.org/project/torchscale/)]
2526

@@ -142,6 +143,8 @@ We have examples of how to use TorchScale in the following scenarios/tasks:
142143

143144
- Vision
144145

146+
* [LongViT](examples/longvit/README.md)
147+
145148
* ViT/BEiT [In progress]
146149

147150
- Speech

0 commit comments

Comments
 (0)