[proof-of-concept] NVFP4 GEMM via BF16 dequant#518

Draft

matthiasdiener wants to merge 126 commits intomdiener/nvfp4-recipefrom

mdiener/nvfp4-gemm

Commits on Nov 15, 2025

Commits on Nov 17, 2025

Commits on Nov 21, 2025

[PyTorch] Fix ONNX export errors (#2406)

pggPL
and
pre-commit-ci[bot]
authored
[PyTorch] Fix for CPU offloading (#2403)

pggPL
and
pre-commit-ci[bot]
authored
Make grad_output contiguous in cross_entropy.py (#2402)
LitLeo
authored
ci: Build and attach bdist wheels to release page (#2138)

ko3n1g
and
ksivaman
authored
[PyTorch] Fix assertion error message formatting in DotProductAttention (#2103)

janbernloehr
and
ksivaman
authored
[JAX] Set BSHD as default in Unfused DPA, DPA and MHA API calls (#2392)

KshitijLakhani
and
pre-commit-ci[bot]
authored
[JAX] Remove unnecessary SWA calculation in _segment_ids_pos_to_seqlens_offsets() (#2201)

KshitijLakhani
and
pre-commit-ci[bot]
authored
Enable SWA with CP for THD input format (#2220)

authored
[PyTorch] Only disable Flash Attention in Userbuffers test on SM 8.0 (#2401)
timmoon10
authored

Commits on Nov 25, 2025

Commits on Nov 26, 2025

Commits on Nov 27, 2025

Change Flax MHA to DPA to remove the duplicated QKV projection step (#2429)
tdophung
authored

Commits on Dec 2, 2025

Commits on Dec 4, 2025

[Core] Fix inconsistent logic in C++ tensor class (#2330)

authored

Commits on Dec 5, 2025

Commits on Dec 6, 2025

[JAX] Add CP + THD + AG + Striped>1 + SWA support (#2379)

authored

Commits on Dec 8, 2025

Commits on Dec 9, 2025

Commits on Dec 10, 2025

Commits on Dec 12, 2025

[PyTorch] Add triton requirement (#2490)

ksivaman
and
tdophung
authored

Commits on Dec 15, 2025

Commits on Dec 16, 2025

Remove test skip logic for GEMM-AR tests (#2516)
vcherepanov-nv
authored

Commits on Dec 17, 2025

Commits on Dec 18, 2025

Commits on Dec 19, 2025

Commits on Dec 20, 2025

Commits on Dec 22, 2025

Fix ptxas compilation on sm103 for triton kernels (#2539)
tdophung
authored

Commits on Dec 27, 2025

[PyTorch] Fuse permute+pad and unpermute+unpad ops for FP8 optimization (#1921)

authored

Commits on Dec 31, 2025

Commits on Jan 2, 2026

Commits on Jan 5, 2026

Commits on Jan 6, 2026

Commits on Jan 7, 2026

Commits on Jan 8, 2026

Solve pytorch-triton and triton package contention (#2540)

tdophung
and
pre-commit-ci[bot]
authored

Commits on Jan 9, 2026

Commits on Jan 10, 2026

Debug doc generation (#2576)
timmoon10
authored

Commits on Jan 13, 2026

Commits on Jan 14, 2026

Revert adding pytorch-triton as a build requirement (#2592)

tdophung
and
pre-commit-ci[bot]
authored

Commits on Jan 16, 2026

[JAX] Custom partitioning for Permutation primitives (#2591)

tdophung
and
pre-commit-ci[bot]
authored

Commits on Jan 17, 2026

Add logic for block-scaled tensors with GEMM swizzled scales (#2486)

authored

Commits on Mar 16, 2026

[ROCm] commit with conflicts as they are
wangye805
committed

Commits on Apr 4, 2026

Minor improvements (#516)
Micky774
authored