Unsloth finetuning without NVIDIA

[Mariam223]

I want to install unsloth to do LLM fine-tuning locally, the problem is that I do not have a dedicated NVIDIA GPU and instead I have "Intel(R) Iris(R) Xe Graphics". Is there any solution to this problem to successfully install unsloth without NVIDIA and CUDA ? also, what are the alternative solutions for fine-tuning ?

[Erland366]

Hello, there's PR going on to support Intel GPU on Unsloth. Unfortunately the PR is not ready yet.

And a PR for AMD GPUs.

Sadly Unsloth is only support NVIDIA GPU. Perhaps for now, you can use our google colab notebooks instead? .-. So sorry for the inconvenience .-.

[github-actions]

Is this issue still important to you? Apologies in advance we might have missed this issue as well. For faster response times, please post on our Reddit server - https://www.reddit.com/r/unsloth or our Discord - https://discord.com/invite/unsloth

[ai-nikolai]

@Erland366 - it seems that AMD is now supported maybe this ticket can be updated with a summary message on where to find the relevant installation guides? @rolandtannous

[CodeNoobLawyer]

@Erland366 - it seems that AMD is now supported maybe this ticket can be updated with a summary message on where to find the relevant installation guides? @rolandtannous

Any tutorial? Mine is AMD Mi50 32GB with ROCM v6.2, how to install unsloth on windows and finetuning LLM? Many thx!