AMD releases Instella-MoE-16B-A3B, an open MoE LLM with 2.8B active parameters

AMD's fully open Mixture-of-Experts LLM has 16B total parameters with only 2.8B active per token. It was trained from scratch on Instinct MI300X and MI325X GPUs, and AMD is publishing weights from every training stage along with data mixtures.