AnalysisAI ModelsDevelopers
27 days ago
Community discusses quantizations of Gemma and Qwen models
Reddit post asks about preferred quantization levels for Gemma and Qwen models. Users debate Q8 vs Q4 vs Q3, with some never going below Q8. Thread has 71 comments.
·
27 days ago