Podcast revisits the development of Galactica and reasoning tokens

Ross Taylor discusses his 2022 work on Galactica, an early large model for science that utilized curated high-quality data and intermediate reasoning tokens. The conversation explores the challenges of optimizing model reasoning processes and the history of early reasoning-focused architectures.

Featured · Ross Taylor