AnalysisAI ModelsOctober 16, 2026

Moritz Hardt argues AI benchmarking is broken, not a science

Read original source →quantamagazine.org

Max Planck's Moritz Hardt says benchmarks have been flawed for decades, calling them "the mistake that made machine learning" in his 2026 book The Emerging Science of Machine Learning Benchmarks. He began suspecting systems could game leaderboards "without doing anything intelligent" after ImageNet's 2012 result.

People · Moritz Hardt

1 source

More stories today

Open the live feed