NVIDIA sets world record for MoE pre-training on GB300 NVL72

NVIDIA achieved a world record for mixture-of-experts (MoE) pre-training using the GB300 NVL72 platform. The record demonstrates the scalability of the Megatron framework for large-scale MoE training.