AnalysisDevelopersOctober 31, 2026

Betelgeuse runs Qwen 3.8 Flash Next IQ4_XS at 24 tok/s on 2x8GB DDR4

Read original source →reddit.com

Betelgeuse's bel-cli/bel-server hit 24 tok/s on IQ4_XS with 2x8GB DDR4 plus an RTX 3060 12GB, and 14 tok/s on a single 16GB stick, with 0 dropped experts and 100% byte-exact output. The test answers pushback over whether 4-bit experts (~2x larger than IQ2_XS) still run.

1 source

More stories today

Open the live feed