AnalysisAI ModelsSeptember 8, 2026

Study: Data improvements drive 3.24x more compute efficiency gains than model tweaks

Read original source →dwarkesh.com

From 2019 to 2025, data improvements yielded 12.0x compute efficiency gains versus 3.7x from model improvements at 1e19 FLOPs, with gains mostly independent. Findings based on training year-representative recipes and data corpuses up to 1e19 FLOPs, evaluated on OLMES.

1 source

More stories today

Open the live feed