AnalysisAI ModelsOctober 5, 2026

Qwen3.8-Flash-Next 125B runs on one Strix Halo mini PC at 44-59 tok/s

Read original source →reddit.com

A 125B MoE model (6B active) runs on a single Ryzen AI Max+ 395 with 128 GB, hitting 44-59 tok/s with speculative decoding and ~1,400 tok/s prefill. The release includes 95 GB EXL3 weights and a new Kyojin engine built on ExLlamaV3.

1 source

More stories today

Open the live feed