AnalysisDevelopersOctober 28, 2026

llama.cpp PR fuses MoE gate/up matmuls and GLU in MMQ for CUDA

Read original source →github.com

Pull request #31188 by anujj reports prompt-processing gains on DGX Spark (GB10): +17.2% on Qwen3-30B-A3B Q4_K_M and +9.9% on Qwen3.6-35B-A3B Q4_K_M versus master. The change targets MoE gate/up matmul and GLU fusion in the MMQ CUDA path.

1 source

More stories today

Open the live feed