AnalysisDevelopersSeptember 21, 2026

Splash engine runs Qwen3.8-27B at 144 tok/s on Apple Silicon

Read original source →reddit.com

Inco's open-source Splash inference engine hits up to 3x Ollama's decode speed and 2x oMLX on Qwen3.8-27B, nearly 4x when an agent fans out into sub-agents. A community extension adds native 8-bit support at 37-55 tok/s on an M5 Pro with 64 GB.

2 sources

More stories today

Open the live feed