AnalysisDevelopersOctober 22, 2026

capy-flash v0.7.1 runs Qwen3.8-Flash-Next 125B MoE in 64 GB RAM

Read original source →reddit.com

The open-source inference engine hits 234 tok/s on two 16 GB RTX 50 cards for the 125B MoE model, down from a prior requirement of two 16 GB cards plus 96 GB of RAM. Qwen3.8-27B at 3-bit now fits a single 16 GB card at 174 tok/s.

1 source

More stories today

Open the live feed