NVIDIA and Artificial Analysis discuss benchmarking open models like Nemotron
Read original source →youtube.com
NVIDIA Developer session features Artificial Analysis explaining how it evaluates open models such as Nemotron and how they compare against the open-weights field. No benchmark figures or results are given in the available text.
1 source
More stories today
Reddit user criticizes Microsoft Copilot's workplace performance
A Reddit poster describes forcing themselves to use Microsoft Copilot at work and calls it a "wake up call," arguing Microsoft has the most agent-worthy workplace surfaces but shipped a weak product.
r/artificial·2 hours agoGPT-6 Astra deciphers 217-year-old Napoleonic letter in 6 hours
SentinelOne engineer Carter Church used GPT-6 Astra to crack a coded 1809 letter to French General Auguste de Marmont that had gone unread for 217 years. The letter held 1,300 encrypted elements and 155 distinct characters, of which researchers previously knew only 33.
r/Singularity·2 hours ago
Claude Opus picks web search correctly 79 of 80 times in tool-use test
A Reddit harness gave Claude models one web_search tool and 40 questions whose answers postdate training cutoffs, without executing the tool. Opus chose to search correctly 79 of 80 times; Sonnet 5 with no system prompt answered that Norway's King Harald V is still alive.
r/ClaudeAI·3 hours agoMIT and Sakana AI framework uses LLM judge to cut coding agent eval costs
The framework targets evaluation costs for self-improving coding agents by replacing full test-suite scoring with an LLM judge. MIT and Sakana AI collaborated on the method.
VentureBeat·3 hours ago

Bengio joins Canada's new national AI council
Yoshua Bengio·3 hours agoOpenAI teases "dot" assistant that coordinates Codex tasks
OpenAI Developers·3 hours agoKelly Clarkson backs a separate chart for AI music
Clarkson says AI can play a significant role in the music industry but wants a clear distinction drawn between AI-made and human-made tracks. She is not alone in calling for a separate AI music chart.
Digital Music News·3 hours ago

Muse Spark and mathematicians solve 6 open math problems
Alexandr Wang·3 hours ago