Skip to content

Conversation

@ispobock
Copy link
Collaborator

Motivation

  1. The dtype in the grok model is bfloat16.
  2. The apply_rope_with_cos_sin_cache_inplace kernel does support float32.

@gemini-code-assist
Copy link
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@ispobock ispobock merged commit e38994d into main Nov 11, 2025
78 of 84 checks passed
@ispobock ispobock deleted the Fix-dtype-in-rope branch November 11, 2025 14:47
pandengyao pushed a commit to pandengyao/sglang that referenced this pull request Nov 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants