gpt-oss Fine-tuning

[shimmyshimmer]

gpt-oss is here! ✨

Finetune gpt-oss for free with our Unsloth Colab notebook!

• We’ve managed to make gpt-oss train on just 14GB of VRAM, making it possible to work on free Colab due to our linear conversions. For more details, Read our Guide/Blogpost
• Fine-tuning gpt-oss is 1.5x faster and uses 50% less VRAM with Unsloth. gpt-oss-120b model fits on 65GB of VRAM.
• Model uploads: 20b GGUF • 120b GGUF • All uploads

🦥 Unsloth updates

• We’ve made algorithmic updates to Unsloth so every model now trains faster and with less VRAM, no matter which.
• Unsloth now works on RTX 50 and Blackwell GPUs. Read our guide.
• Official Unsloth Docker image coming very soon!
• You can now run Unsloth models directly via Docker: docker model pull hf.co/unsloth/gpt-oss-20b-GGUF

🌠 Qwen3-Coder + Qwen3-2507

Qwen made July, 2025 updates called 'Qwen3-2507' and launched their SOTA coding models!

• Qwen3-Coder (with Unsloth fixes): Guide • Coder uploads
• Qwen3-2507: Guide • 2507 uploads
• Fine-tune Qwen3-4B-2507 with our Colab notebook

🔮 New models + Support:

Run these new models:

• Kimi-K2: Guide • GGUF
• GLM: 4.5-Air • 4.5 • 4-32B-0414
• Orpheus-3B • Hunyuan-A13B

Unsloth also now supports running + training for:

• Devstral-2507 • Magistral-2507 • SmolLM3-3B • Falcon-H1-7B • LFM2-1.2B

Don't forget to also join our Reddit: r/unsloth 🥰

---

This discussion was created from the release gpt-oss Fine-tuning.