Sparse attention and KV compression evaluation tricks exposed

A researcher who has spent years on efficient attention and KV cache compression explains how evaluation choices can make any sparse-attention or KV-compression method look good. The post draws on close reading of reference and official implementations of many published methods.