AnalysisAI ModelsSeptember 8, 2026

Study: Data improvements drive 3.24x more compute efficiency gains than model tweaks

From 2019 to 2025, data improvements yielded 12.0x compute efficiency gains versus 3.7x from model improvements at 1e19 FLOPs, with gains mostly independent. Findings based on training year-representative recipes and data corpuses up to 1e19 FLOPs, evaluated on OLMES.

1 source

More stories today

Open the live feed