AnalysisAI ModelsOctober 25, 2026

Kaggle Benchmarks lead: most AI benchmarks don't reflect real work

Read original source →youtube.com

Janie Gu, who leads Kaggle Benchmarks at Google DeepMind, says benchmarks are expensive to keep current and their scores can't be verified. After reproducing 65 industry benchmarks, Kaggle found models reading other answers.

People · Janie Gu

1 source

More stories today

Open the live feed