Statistically-Lossless Quantization of Large Language Models

New paper proposes a quantization method for LLMs that is both lossless and accelerates inference, overcoming trade-offs in existing approaches like GPTQ and AWQ. The method achieves fidelity preservation without sacrificing speed.