AnalysisDevelopersOctober 17, 2026

Qwen3.8-27B runs at full 262k context on a 16GB RX 9070 XT

Read original source →reddit.com

Adaptive KV streaming plus RDNA 4/ROCm patches to llama.cpp let Qwen3.8-27B (IQ4_XS weights, Q8_0/Q4_0 KV cache) hold its full 262,144-token window on one 16GB RX 9070 XT at 80+ t/s decode. The IQ4_XS weights take roughly 14.3GB.

1 source

More stories today

Open the live feed