AnalysisAI ModelsAugust 23, 2026

Kimi K3 (2.8T params) hosted on 8 B300s hits 92 tok/s

A user hosted Kimi K3 (2.8T parameters) on 8x B300s via Modal with vLLM, achieving 92 tok/s decode and $190 per million output tokens. Cold boot took ~27 minutes for the 1.56 TB load.

1 source

More stories today

Open the live feed