Out of RAM in Colab

[SBFallout]

Run example/finetune.ipynb, but end with crash for runnnig out server RAM.
Colab runtime: free GPU runtime (T4, 12G RAM)

[senwu]

We have tested the finetune notebook on A6000 24GB.

[SBFallout]

We have tested the finetune notebook on A6000 24GB.

Q1: Is there any possible to reduce RAM consumption?
Q2: Is there any plan to upload a mini one with less resource demand?

[senwu]

You can try our 350M model (https://huggingface.co/NumbersStation/nsql-350M) which can fit on T4.

We are working to reduce the RAM consumption. Stay tuned!