FlashAttention-3 Windows + CUDA 13.0 build fails with C2719 “formal parameter with requested alignment of 128 won’t be aligned”

[windreamer]

Problem
Compilation aborts while generating the SM90 BF16 backward kernel (flash_bwd_hdim128_bf16_softcapall_sm90.cu).
The MSVC front-end emits > 100 identical errors:

error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned

and finally:

fatal error C1003: error count exceeds 100; stopping compilation

All errors point to the auto-generated *.cudafe1.stub.c file, never to user code.

Logs

tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.cpp
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(190): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(217): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(226): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(235): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(253): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(262): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(271): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(280): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(289): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(298): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(307): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(316): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(325): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(334): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(343): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(352): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(370): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(388): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(397): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(406): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(424): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(433): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(442): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(451): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(460): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(469): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(478): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(487): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(496): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(505): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(514): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(523): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(532): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(541): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(550): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(559): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(568): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(577): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(586): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(595): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(604): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(613): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(622): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(631): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(640): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(649): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(658): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(667): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(676): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(677): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(678): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(679): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(680): error C2719: 'unnamed-parameter': formal parameter with requested alignment of 128 won't be aligned
C:\Users\runneradmin\AppData\Local\Temp\tmpxft_00002734_00000000-7_flash_bwd_hdim128_bf16_softcapall_sm90.cudafe1.stub.c(680): fatal error C1003: error count exceeds 100; stopping compilation

Thank you!