New research advances LLM post-training quantization techniques

Recent papers introduce ReQuant and CubicQuant to improve model compression, while researchers identify that quantization damage is multiplicative rather than additive. A community project, KLQ, also released a training-free rotation-based quantization method for Llama 3.2 1B.