Community releases abliterated and quantized Gemma 4 12B models

Hugging Face Models

Multiple community fine-tunes and official GGUF quantizations of Google's Gemma 4 12B IT model have been uploaded to HuggingFace. A popular abliterated version by huihui-ai removes safety restrictions, while Google also released an official QAT GGUF.

GemmaHugging Face

See 3 more sources

OBLITERATUS/Gemma-4-12B-OBLITERATED13 days agoOBLITERATUS

google/gemma-4-12B-it-qat-q4_0-gguf15 days agogoogle

unsloth/gemma-4-12B-it-qat-GGUF16 days agounsloth

Hugging Face Models·huihui-ai

Jun 5, 12:28 AM