AnalysisAI ModelsOctober 2, 2026

Builder clusters 6 ex-mining BC-250 boards to run Qwen locally

Read original source →reddit.com

Six BC-250 ex-mining boards in an ASRock 4U12G case run Qwen Next Flash IQ2_XS at ~28 tok/s short generation and 24 tok/s at 50k context, with ~115 ppt. An earlier 5-board build exposed ~71GB VRAM and hit 40 tok/s at 30k context, dropping to ~30 tok/s at 100k.

2 sources

More stories today

Open the live feed