Spotify teaches LLMs to reason over catalog with Semantic IDs

Spotify represents artists like Ariana Grande and Bruno Mars as sequences of six tokens, called Semantic IDs, to enable LLMs to understand their catalog. The first two tokens encode shared traits like genre, while later tokens capture unique characteristics.