AnalysisDevelopersJuly 14, 2026
New FP4 attention kernels for B300 achieve up to 1.69x speedup
The kernels target B300 hardware and offer up to 1.69x speedup over FlashAttention 4 (FA4), as detailed in a tweet from haoailab. The results include benchmark comparisons and kernel design notes.