AnalysisAI ModelsOctober 9, 2026

GSQ-RCO GGUFs bring Qwen3.8-Flash-Next to 12GB GPUs

Read original source →reddit.com

GSQ-RCO quantizations of Qwen3.8-Flash-Next, a 176.9B-parameter sparse MoE with 512 routed experts across 48 layers, run at 15-30 tok/s decode on 12GB VRAM plus 32GB system RAM. A 50% expert-pruned Coder build lands at ~1.89 bpw.

How this story unfolded

3 weeks · 0 reports · 5 community posts · from Sep 16

  1. Sep 16
  2. Sep 29
  3. Oct 9

More stories today

Open the live feed