Moonshot AI releases Kimi K3, a 2.8T parameter sparse MoE model

The 2.8T parameter model features native vision support, a 1M token context window, and 2.5x better scaling efficiency than Kimi K2. It introduces Kimi Delta Attention and Attention Residuals architectures, and is now available on Together AI, AWS, and Nebius.