Working Docker Image for training Qwen3 on multiple RTX 5090

[thad0ctor]

I played around with MrShahzebKhoso's [commit] 8823d60) and was able to set up a venv and a docker compatible with RTX 5000 series GPUs (blackwell) that comes preinstalled with a patched version of unsloth to support multi GPU training with accelerate and flash-attention 2. I couldn't get xformers to work for the life of me but it seems to work incredibly well with my 5090s.

Docker Image
GitHub
Reddit