Add GLM-5 NVFP4 B200 TP8 SGLang benchmark (conc 4-64)#973
Merged
functionstackx merged 5 commits intomainfrom Mar 29, 2026
Merged
Add GLM-5 NVFP4 B200 TP8 SGLang benchmark (conc 4-64)#973functionstackx merged 5 commits intomainfrom
functionstackx merged 5 commits intomainfrom
Conversation
functionstackx
requested review from
jgangani and
kedarpotdar-nv
as code owners
Contributor
|
Thanks for the contribution! For vLLM & SGLang, please ensure that your recipes is similar to the official vLLM recipes and/or the SGLang cookbook If it is not, please create a PR first before we can merge your PR into the master branch. Let's ensure that the documentation is first class such that the entire ML community can benefit from your hard work! Thank you |
Contributor
Author
|
@claude use nightly-dev-cu13-20260328-a27651d5 tag instead |
Collaborator
|
Claude finished @functionstackx's task in 50s —— View job Updated image tag to
|
- Add glm5-nvfp4-b200-sglang config to nvidia-master.yaml - Create benchmark script with modelopt_fp4 quantization, glm47 tool-call-parser, glm45 reasoning-parser, chunked-prefill-size 131072, mem-fraction-static 0.80 - Uses image lmsysorg/sglang:nightly-dev-cu13-20260305-33c92732 - Model: nvidia/GLM-5-NVFP4 Closes #972 Co-authored-by: functionstackx <functionstackx@users.noreply.github.com>
Co-authored-by: functionstackx <functionstackx@users.noreply.github.com>
functionstackx
force-pushed
the
claude/issue-972-20260329-0102
branch
from
1ecda71 to
c625c7a
Compare
Contributor
Author
|
@claude the perfchangelog diff should be at bottom of file... remember to have new line at end of file too |
Collaborator
|
Claude finished @functionstackx's task in 57s —— View job Moved perf-changelog entry to bottom of file
|
Co-authored-by: functionstackx <functionstackx@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Add GLM-5 NVFP4 single-node B200 SGLang benchmark with modelopt_fp4 quantization.
following https://huggingface.co/nvidia/GLM-5-NVFP4 recipe
Closes #972
Generated with Claude Code