Skip to content

docs: Update guide to include minimum compute requirement #505

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
Jul 3, 2025
Merged

docs: Update guide to include minimum compute requirement #505

Changes from 1 commit
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
27e3971
Update guide to include minimum compute requirement
abukharin-nv Jun 11, 2025
1905fd8
Update min requirements for A100
abukharin-nv Jun 11, 2025
684978c
grammar
abukharin-nv Jun 11, 2025
00b1977
Update docs/guides/grpo-deepscaler.md
abukharin-nv Jun 27, 2025
a28b4f1
Merge branch 'main' into abukharin/deepscaler-guide
parthchadha Jul 3, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/guides/grpo-deepscaler.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ At the end of each stage, you need to specify the Hugging Face checkpoint to con
uv run examples/convert_dcp_to_hf.py --config=results/grpo-deepscaler-1.5b-8K/step_240/config.yaml --dcp-ckpt-path=results/grpo-deepscaler-1.5b-8K/step_240/policy/weights --hf-ckpt-path=results/grpo-deepscaler-1.5b-8K/step_240/hf
```

When running the next command, we use the Hugging Face checkpoint as the initial checkpoint. We train with an 8K context window for 240 steps, a 16K context window for 290 steps, and a 24K context window for 50 steps. We run all experiments on a single 8XH100 80GB node or on a single 8XA100 80GB node.
When running the next command, we use the Hugging Face checkpoint as the initial checkpoint. We train with an 8K context window for 240 steps, a 16K context window for 290 steps, and a 24K context window for 50 steps. We run all experiments on a single 8XH100 80GB node. The minimum requirement for training is 8XA100 80GB for 8K training and 8XH100 80GB for 16K and 24K training.

## Training Curve
When using the above commands, we get the following training curve:
Expand Down
Loading