Google DeepMind's Text Diffusion Model Shows Self-Correction

Brendon Dillon presents Gemini Diffusion, a text diffusion model that answered 60 on first pass, corrected to 39 after reasoning—outperforming GPT-4o (40) and Gemini 2.5 Flash (42) on a reasoning task. The model uses bidirectional reasoning, unlike autoregressive models.