AnalysisDevelopersOctober 27, 2026

Local inference engines race to speed up Qwen3.8-Flash-Next

Read original source →github.com

Strata, Basalt, tandem.cpp, capy-flash and QEngine all target the 125B MoE model, with Basalt hitting up to 275 tok/s generation and 5,500 tok/s prompt processing on a single RTX 5080. tandem.cpp claims 3.3× llama.cpp at 97 tok/s on a 4090, and capy-flash v0.7.1 runs the model in 64 GB of RAM.

How this story unfolded

13 days · 0 reports · 17 community posts · from Oct 21

  1. Oct 21
  2. Oct 22
  3. Oct 23
  4. Oct 24
  5. Oct 25
  6. Oct 26
  7. Oct 27
  8. Oct 28
  9. Oct 29
  10. Oct 31
  11. Nov 1
  12. Nov 2
  13. Nov 3

More stories today

Open the live feed