Google drops Gemma QAT checkpoints for mobile on HuggingFace

View on Reddit

Google released quantization-aware trained Gemma checkpoints optimized for mobile device inference. The checkpoints are available as a collection on HuggingFace. This enables on-device AI with reduced memory and compute requirements.