Moonshot AI launches Kimi K3: 2.8T parameter open-weight model

The 2.8-trillion-parameter model features a 1-million-token context window and native multimodal capabilities. Kimi Delta Attention enables up to 6.3x faster decoding in long contexts, while Attention Residuals improve training efficiency by ~25%.