Moonshot AI launches Kimi K3, a 2.8T-parameter open-weight multimodal model

Kimi K3 has 2.8 trillion parameters, 1 million token context, and native multimodal capabilities. Kimi Delta Attention enables up to 6.3x faster decoding, while Attention Residuals deliver ~25% higher training efficiency.