MorphoQuant: Modality-aware 4-bit quantization for omni-modal LLMs

Arxiv CS.CV (computer vision)

Proposes MorphoQuant, a quantization method addressing extreme distribution heterogeneity across modalities in 4-bit OLLMs. It outperforms conventional PTQ by handling outlier patterns specific to each modality.

llm

Arxiv CS.CV (computer vision)·Yue WuChangyuan WangZixuan WangShilin MaYansong Tang

7 days ago