AnalysisDevelopersOctober 14, 2026

llama.cpp PR adds chunked GDN kernel for CUDA and HIP

Read original source →github.com

Pull request #29353 by am17an adds a chunked GDN kernel to llama.cpp, lifting prompt processing on an RTX PRO 6000 Blackwell with Qwen3.5-35B-A3B-Q8_0 from 13,653 to 16,459 tok/s at 2048 tokens (+20.6%). At 4096 tokens the gain is +17.8%, 14,090 to 16,595 tok/s.

1 source

More stories today

Open the live feed