Skip to content

Pull requests: Dao-AILab/flash-attention

New pull request New
81 Open 323 Closed
81 Open 323 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Cute,Fwd,Sm100] Support q_stage=1 for inference
#1993 opened Nov 7, 2025 by timmy-feng Loading…
2
[Cute,Fwd,Sm90] Support KV cache
#1992 opened Nov 6, 2025 by imbr92 Loading…
2
[Cute] Block sparse support Sm100
#1985 opened Nov 5, 2025 by drisspg Loading…
6
Local window attention deterministic mode efficiency improvement
#1972 opened Oct 29, 2025 by GD06 • Draft
Make wheel name and version consistent
#1956 opened Oct 22, 2025 by bobingm Loading…
1
fix: nan when m_i_new=-inf in online softmax
#1948 opened Oct 20, 2025 by tongyx361 Loading…
1
support cpu run fa triton kernel
#1938 opened Oct 15, 2025 by hellozmz • Draft
windows error error C2039:
#1932 opened Oct 12, 2025 by Granddyser Loading…
[NFC] Trivial fix to silence linter
#1928 opened Oct 8, 2025 by jduprat Loading…
feat: add to support float8 kvcache in fa4
#1914 opened Sep 28, 2025 by yicwang Loading…
3
fix forward and backward kernel
#1907 opened Sep 24, 2025 by rz2778 Loading…
Add flash_attn_varlen_qkvpacked_func to hopper (flash_attn_3)
#1902 opened Sep 22, 2025 by foreverYoungGitHub Loading…
Feature/varlen rotray
#1899 opened Sep 19, 2025 by mhoangvslev Loading…
Improve setup.py
#1859 opened Sep 3, 2025 by cyyever Loading…
feat: Implement Sink Attention
#1819 opened Aug 18, 2025 by aoxy Loading…
1
17
fix race condition bug in cute _flash_attn_fwd in multiple gpu env
#1793 opened Aug 1, 2025 by beiw-nv Loading…
3
feat: blocksparse support
#1784 opened Jul 30, 2025 by guangyunh-nv • Draft
[CI] build upon manylinux, improve compatibility
#1780 opened Jul 29, 2025 by zipzou Loading…
11
Change the update method of the sub-module
#1774 opened Jul 25, 2025 by RealTapeL Loading…
add var_len case for benchmark_mla_decode
#1770 opened Jul 22, 2025 by XiaobingSuper Loading…
1
Add torch.compile support to flash attention 3
#1769 opened Jul 22, 2025 by guilhermeleobas Loading…
60
Suppress warnings in windows compilation
#1748 opened Jul 10, 2025 by XXXXRT666 Loading…
6
Fix illegal memory access through off-by-one error in num_splits_dynamic_ptr init
#1747 opened Jul 10, 2025 by klondenberg-bioptimus Loading…
Theoretically make compiling from pip quicker
#1703 opened Jun 8, 2025 by whrit Loading…
fix: fa3 backward check qkv with qkv_scale and dqkv
#1686 opened May 29, 2025 by yuyu5333 Loading…
1
ProTip! Exclude everything labeled bug with -label:bug.