Scaling Properties of Continuous Diffusion Spoken Language Models

Apple ML Research paper introduces the phoneme Jensen-Shannon divergence (pJSD) metric to quantify linguistic quality of spoken language models. Scaling continuous diffusion SLMs to 16B parameters with tens of millions of hours of data enables emotive, prosodic, multi-speaker multilingual speech, though long-form coherence remains challenging.