[Feature] Direct Support / Documentation for Early Stopping #2835
devansh-lodha
started this conversation in
General
Replies: 1 comment
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi Unsloth Team,
First off, thanks for the great library and making finetuning more accessible!
I understand that early stopping (based on validation loss, for example) is currently possible by configuring the standard Hugging Face
TrainingArgumentswhen usingSFTTrainer(by settingevaluation_strategy,eval_steps,load_best_model_at_end,metric_for_best_model,early_stopping_patience, etc., and providing aneval_dataset).However, as a user, especially one newer to the ecosystem, discovering and configuring these multiple arguments correctly can be a bit of a hurdle. It would be really helpful to have more "direct" support or visibility for this feature within the Unsloth ecosystem.
Specifically, I'd like to request:
docs.unsloth.aiexplaining exactly how to set up early stopping (based on validation loss) within an Unsloth training script (like the Qwen-VL example notebook). Showing the necessarySFTConfigarguments would be fantastic.--evaluation_strategy,--eval_steps,--load_best_model_at_end,--metric_for_best_model,--early_stopping_patience) to theunsloth-cli.pyscript for users who prefer that interface.Making this useful feature more discoverable and straightforward to implement would be a great enhancement.
Thanks for considering!
Beta Was this translation helpful? Give feedback.
All reactions