AnalysisAI ModelsOctober 2, 2026

Claude Opus picks web search correctly 79 of 80 times in tool-use test

Read original source →reddit.com

A Reddit harness gave Claude models one web_search tool and 40 questions whose answers postdate training cutoffs, without executing the tool. Opus chose to search correctly 79 of 80 times; Sonnet 5 with no system prompt answered that Norway's King Harald V is still alive.

1 source

More stories today

Open the live feed