AnalysisAI ModelsSeptember 4, 2026

Random Attention: KV cache eviction without scoring

Random eviction of reasoning tokens matches selective KV cache compression because reasoning traces are self-protecting through redundancy, making scoring unnecessary once prompts are preserved. The paper reports 10 authors and 50 HF upvotes.

1 source

More stories today

Open the live feed