Moonshot AI launches Kimi K3, a 2.8T parameter open-weight model

2.8 trillion parameters, 1M token context window, and native multimodal. Kimi Delta Attention speeds decoding up to 6.3x in long contexts; Attention Residuals boost training efficiency ~25% at under 2% overhead. Open-weight release.