Running Unsloth GRPO notebook in Windows

[vitoiitmBSc]

Hi ,

I am trying to run GRPO unsloth notebook from this reference here

https://github.com/matthewchung74/qwen_2_5_3B_GRPO_medical_thinking/blob/main/Qwen2_5_(3B)_GRPO.ipynb

After the setting up the initial downloads

import sys; modules = list(sys.modules.keys())
for x in modules: sys.modules.pop(x) if "PIL" in x or "google" in x else None

%pip install "unsloth==2025.2.4" vllm
%pip install -q --upgrade pillow
%pip install -q transformers==4.48.2
%pip install -q rouge_score bert_score datasets evaluate scikit-learn sentence_transformers sacremoses

If you are running this notebook on local, you need to install diffusers too

%pip install -q diffusers
##Temporarily install a specific TRL nightly version
%pip install -q git+https://github.com/huggingface/trl.git@e95f9fb74a3c3647b86f251b7e230ec51c64b72b

when I try to download the GRPO library

from unsloth import FastLanguageModel, PatchFastRL
PatchFastRL("GRPO", FastLanguageModel)

I get the below error :

RuntimeError: Failed to import trl.trainer.grpo_trainer because of the following error (look up to see its traceback):
No module named 'vllm._C'

I am using Windows locally and just read somewhere vllm will work only in LINUX , is there a workaround?

Please help