LaunchDevelopersJuly 7, 2026

mistral.rs v0.9.0 claims 1.8x faster CPU decode than llama.cpp

On Qwen3 4B Q4_K, mistral.rs v0.9.0 decodes faster than llama.cpp at every context depth on x86 (Sapphire Rapids) and ARM (GB10). The release claims optimizations yield up to 1.8x speedup.

1 source

mistral.rs v0.9.0 claims 1.8x faster CPU decode than llama.cpp — AIBriefs