AnalysisDevelopersOctober 23, 2026

llama.cpp PR refactors Intel XMX engines, speeding B70 spec decoding

Read original source →github.com

Pull request #29864 by budiony reworks Intel XMX matrix engines in llama.cpp, which the poster says gave a huge speculative-decoding speedup on a B70 running SYCL. Benchmarks use Muse Glimmer Q6_K (30B) with DFlash2; lower token-verification cost allowed a higher n-max.

1 source

More stories today

Open the live feed