AnalysisAI ModelsOctober 25, 2026

Lean-QwenFlash runs 125B Qwen3.8-Flash-Next on 16GB VRAM via NVMe offload

Read original source →reddit.com

Setup streams the model's 24k experts from a direct NVMe SSD instead of pinning them in system RAM (~48–64 GB) as Strata does, hitting ~20 tok/s on 16GB VRAM plus 8GB RAM. Aimed at laptops and normal machines rather than high-spec workstations.

1 source

More stories today

Open the live feed