AnalysisAI ModelsOctober 25, 2026

Lean-QwenFlash runs Qwen3.8-Flash-Next 125B on 16GB VRAM

Read original source →reddit.com

Setup streams the 125B model's 24k experts from NVMe instead of pinning them in 48–64GB of system RAM, hitting ~20 tok/s on 16GB VRAM plus 8GB RAM. Author MaxDev0 positions it against Strata, which keeps all experts in RAM and computes cache misses on CPU.

1 source

More stories today

Open the live feed