AnalysisAI ModelsOctober 25, 2026

Basalt runs Qwen3.8 Flash Next IQ3_S at 250 tok/s on 16GB VRAM

Read original source →reddit.com

On an RTX 5080 16GB with a Core Ultra 9 285K and 62GB DDR5-6800, Qwen3.8-Flash-Next IQ3_S hit 250 tok/s generation and 5,600 tok/s prompt processing at concurrency 1. The run used 262K context with int8 KV cache.

1 source

More stories today

Open the live feed