AnalysisDevelopersJuly 14, 2026

New FP4 attention kernels for B300 achieve up to 1.69x speedup

The kernels target B300 hardware and offer up to 1.69x speedup over FlashAttention 4 (FA4), as detailed in a tweet from haoailab. The results include benchmark comparisons and kernel design notes.

1 source