Moonshot AI releases Kimi K3, a 2.8T parameter sparse MoE model

The 2.8T parameter model features a 1M token context window and native vision support, delivering 2.5x better scaling efficiency than Kimi K2. It introduces Kimi Delta Attention and Attention Residuals architectures, achieving top rankings on Agent Arena and full-stack coding benchmarks.