Community releases Gemma4 QAT models with MTP speed boosts

Hugging Face Models

HauhauCS released Gemma4-26B-A4B and 31B-QAT Balanced QAT models with Multi-Token Prediction, claiming 35% and 53% speed boosts. The uncensored fine-tunes are already trending on HuggingFace with over 28,000 downloads.

GemmaHugging Face

See 1 more source

Gemma4-26B-A4B & 31B-QAT Uncensored Balanced are out with MTP (35% & 53% speed boost)!6 days agohauhau901Discuss

Hugging Face Models·HauhauCS

Jun 24, 11:43 PM