Kimi K3: 2.8T parameter open-weights model launches

Moonshot AI released Kimi K3, a 2.8 trillion parameter language model with 1 million token context and native multimodal capabilities. The model uses Kimi Delta Attention for up to 6.3x faster decoding and Attention Residuals for ~25% higher training efficiency.