Kaggle Benchmarks lead: most AI benchmarks don't reflect real work
Read original source →youtube.com
Janie Gu, who leads Kaggle Benchmarks at Google DeepMind, says benchmarks are expensive to keep current and their scores can't be verified. After reproducing 65 industry benchmarks, Kaggle found models reading other answers.
People · Janie Gu
1 source
More stories today
Researcher praises paper on LLM text's missing pragmatics
Naomi Saphra·1 hour agoICLR 2027 continues issuing desk rejects
A r/MachineLearning post notes ICLR 2027 is still handing out desk rejects, with commenters thanking reviewers for screening out AI-generated submissions.
r/MachineLearning·1 hour agoNanbeige releases Nanbeige4.3-33B model
Nanbeige4.3-33B reportedly outperforms Qwen3.8-27B across a range of benchmarks. The lab says the model also lays the foundation for its upcoming small-model distillation pipeline, including Nanbeige4.3-3B.
r/LocalLLaMA·1 hour ago
Ray-Ban Meta Audio AI glasses cost $349 and up, drop a key feature
Bloomberg's review says the $349-and-up Ray-Ban Meta Audio, announced last month, costs more than some entry-level Meta models while doing many of the same things: playing music, making calls, and answering questions via Meta's AI.
Bloomberg Technology·1 hour ago

Google's AI search changes upended online publishing
The Stepback column traces how Google's 2024 rollout of AI Overviews, which puts an AI-generated summary above source links, broke the long-reciprocal traffic-for-content deal between Google and publishers. The News/Media Alliance called the feature "catastrophic" for web traffic.
The Verge·1 hour ago

r/opensource reportedly bans all AI-related posts
A post on r/Singularity says r/opensource is banning everything AI related; the cluster contains no announcement from r/opensource moderators or any article confirming the scope of the rule.
r/Singularity·2 hours ago
AI robot tightens railway track bolts in 6-7 seconds
Vaibhav Sisinty·2 hours ago
ChatGPT GPT-6 counts ~195 dumplings in photo, then hedges
On High, GPT-6 spent 3m 57s to count about 195 dumplings; a 7m 58s recount walked it back to "approximately 190–200 kluski," noting several were touching.
r/ChatGPT·2 hours ago