Skip to content

Pull requests: KellerJordan/modded-nanogpt

New pull request New
15 Open 81 Closed
15 Open 81 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

New Record: Batch size schedule (-2 seconds)
#163 opened Nov 30, 2025 by varunneal Loading…
2
fix: use per-rank device for dummy backward to avoid wasted GPU memory on rank 0
#161 opened Nov 23, 2025 by staghado Loading…
New Medium WR - Remove a redundant op while creating block masks, -220 ms
#157 opened Nov 13, 2025 by manikbhandari Loading…
1
New WR: Preconditioned orthogonalization for faster Muon optimizer
#155 opened Nov 11, 2025 by thib-s Loading…
9
New Medium WR: Smear-MTP (-9.93 seconds)
#151 opened Nov 3, 2025 by snimu Loading…
4
New Medium WR: -8.5s; re-do of #138; includes changes from #137
#139 opened Oct 4, 2025 by snimu Loading…
New medium track WR: combined #129 and #128
#137 opened Sep 30, 2025 by acutkosky Loading…
1
Medium track WR, ema on top of muon, includes PR124.
#129 opened Sep 17, 2025 by acutkosky Loading…
2
New medium track WR: 1404s. Snoo Optimizer. Includes #124 and #119
#128 opened Sep 16, 2025 by dominikkallusky Loading…
3
New medium track WR: Second input embedding (1412 seconds); includes #119
#124 opened Sep 11, 2025 by snimu Loading…
6
[WIP] Add new record found by automated search
#123 opened Sep 11, 2025 by leloykun • Draft
4
Update train_gpt_medium.py
#121 opened Sep 8, 2025 by Shri5648 Loading…
record 2025-08-28; medium track; two more value-embeddings
#119 opened Aug 28, 2025 by snimu Loading…
6
Improved logging
#98 opened May 10, 2025 by YouJiacheng Loading…
Add efficient validation on HellaSwag
#89 opened Mar 13, 2025 by trianxy Loading…
5
ProTip! Mix and match filters to narrow down what you’re looking for.