Moonshot AI launches Kimi K3, a 2.8T parameter frontier model

Kimi K3 features 2.8 trillion parameters, 1 million context length, and native multimodal capabilities. Its Kimi Delta Attention delivers up to 6.3x faster decoding in long contexts, while Attention Residuals boost training efficiency by ~25%.

Featured · Yang Zhilin