AnalysisDevelopersNovember 6, 2026

Saber inference engine hits 6,645 tok/s prefill on Qwen3.8 27B

Read original source →reddit.com

A developer's Saber inference engine reports 6,645 tok/s prefill and 316 tok/s decode peak running Qwen3.8 27B. The author says he sat on the release for over a month and claims a different approach from the flood of existing engines.

1 source

More stories today

Open the live feed