AnalysisDevelopersOctober 25, 2026

Cerebras details serving 3T-parameter Kimi K3 across WSE-3T wafers

Read original source →cerebras.ai

Cerebras splits Kimi K3's ~3 trillion parameters across multiple WSE-3T wafers, each with 44 GB of on-chip memory, to hit 1000-2000+ tokens per second. The 93-layer model uses 4-bit weights and an 8-bit KV cache, with one dense layer per wafer to leave room for KV cache.

1 source

More stories today

Open the live feed