Kimi K3: 2.8T parameter open frontier model from Moonshot AI

Kimi K3 has 2.8 trillion parameters, 1 million context length, and native multimodality. Its Kimi Delta Attention enables up to 6.3x faster decoding in million-token contexts, while Attention Residuals deliver ~25% higher training efficiency.