AnalysisAI ModelsSeptember 26, 2026

Block sparse attention paper targets log-linear long-context cost

Read original source →arxiv.org

Paper proposes block sparse attention with log-linear complexity to cut the quadratic cost of self-attention on long contexts. It argues conventional block selection, which scores all query-block pairs, remains the bottleneck.

1 source

More stories today

Open the live feed
Block sparse attention paper targets log-linear long-context cost