AnalysisAI ModelsNovember 8, 2026

MACaQ quantization method beats Unsloth GGUFs on KL divergence

Read original source →arxiv.org

MACaQ is an MXFP4 W4A4 post-training quantization method that quantizes each linear layer independently with online activation transforms and Hessian-aware refinement. On Qwen3-4B IQ4_XS, MACaQ hit 0.02804 mean KL at 2.260 GB versus Unsloth's 0.03663 at 2.271 GB.

3 sources

More stories today

Open the live feed