Models other than available in torchtune.models

[sovit-123]

Is it possible to download and fine-tune any model in Hugging Face by providing the token or only models listed under torchtune.models are accessible?

[joecummings]

Great question! torchtune is very flexible so most transformer models provided by the Hugging Face hub should work; however, you may need to define your own model component that plugs into the recipe (very easy). The models we provide under torchtune.models are the ones we tested personally so we're confident they work.

Is there a certain model you want to use that isn't covered by torchtune.models?

[sovit-123]

Wanted to try out full fine-tuning for some smaller models like SmolLM2. Will try out according to what you suggested.

Thanks.

[joecummings]

Awesome, LMK how it goes! You can also probably get quicker responses from me and the team on Discord btw.

[sovit-123]

That's great to hear. Will surely join it.