Quantization's hidden cost: multilingual and decision-level damage

New arXiv papers show low-bit quantization disproportionately harms non-English languages (2-4x perplexity degradation in sub-4B INT3 GPTQ) and can flip MoE routing decisions. Proposals include Language-Conditional Dequantization and methods to predict which decisions break.