New papers push KV cache compression for long-context LLMs

A wave of arXiv papers targets KV cache memory bottlenecks in long-context LLM inference, proposing methods like LinearKV, QV-PIC, VoxZip, CommitKV, SPECTRA, and others. Techniques include position-independent caching, quantization, eviction, and compression to reduce memory and bandwidth costs.