(This is not SageAttention3. For SageAttention3 you can download the wheel at https://github.com/mengqin/SageAttention/releases , and see the discussion at #42 (comment) )

Fix GQA case for smooth_k, see thu-ml#252

Previously the SageAttention2++ kernels may not correctly fallback to the old SageAttention2 kernels on RTX 40xx and CUDA < 12.8 . Now it's fixed, see #46

The wheels for PyTorch 2.9 are published. CUDA 13.0 is supported since PyTorch 2.9 .