AMD releases Instella-MoE-16B-A3B, a fully open MoE LLM

Instella-MoE-16B-A3B has 16B total parameters but activates just 2.8B per token, trained from scratch on AMD Instinct MI300X and MI325X GPUs. AMD published weights from every training stage, plus data mixtures and training details, for full openness.