New KV-cache compression methods aim to reduce LLM inference memory

Multiple arXiv papers propose techniques including Codec-Gauge, C^2KV, low-bit quantization, and SelKV to compress KV caches. Open-source tools like DKV and CachyLLama implement similar ideas for local inference.