Google outlines behavioral evals for AI coding agents
Google Developers Blog argues end-to-end benchmarks like Terminal-Bench and DeepSWE are expensive, slow, and lack root-cause diagnostics when scores shift. It recommends behavioral evaluations that measure discrete, observable agent actions as integration tests for harness engineering.
1 source
More stories today
Nscale adds former OpenAI exec Fidji Simo to board ahead of IPO
Simo, formerly OpenAI's CEO of AGI Deployment and No. 2 exec, joins the U.K. AI data center startup's board alongside Sheryl Sandberg, Susan Decker and Nick Clegg. Nscale is reportedly raising up to $3.5B ahead of a planned IPO this fall.
TechCrunch·1 hour ago
Reddit post argues professionals resist AI over economic fears
A r/Singularity post contends that mathematicians and other professionals oppose AI because it threatens their livelihoods, not out of concern for human value. The author argues people would welcome AI if their place in society were already secured.
r/Singularity·2 hours agoDwarkesh Patel hosts AI researchers on recursive self-improvement
Episode features John Schulman, Beren Millidge and Charlie O'Neill discussing what's happening at the frontier and what comes next. The first segment, running to 18:39, steelmans the case against recursive self-improvement.
Dwarkesh Patel·2 hours ago
Qwen3.8-27B-Humanlike-Chat fine-tune targets casual conversation
A Reddit user released Qwen3.8-27B-Humanlike-Chat, a fine-tune of Qwen3.8-27B built to drop the polished "AI assistant" tone for realistic human-to-human conversation. The creator cites over-helpfulness, verbosity, and unnatural word choice in existing models as motivation.
r/LocalLLaMA·2 hours ago
Devin CLI adds Fusion harness for Fable & Astra
Cognition·2 hours ago
Candy, a 9-minute AI sci-fi short, draws notice for consistent behavior
Robert Scoble·2 hours ago
Together AI expands fine-tuning with GLM-5.3, Kimi K2.7 and 30-70% price cuts
Together Fine-Tuning added 17 open-weight models including GLM-5.3, Kimi K2.7-Code, DeepSeek-V4-Flash and the Qwen 3.5 family (0.8B-9B), plus live run metrics, experiment comparisons, early stopping and dataset previews. Prices dropped 30-70% on selected models.
Together AI Blog·2 hours ago
.png)
Hugging Face security.txt tells AI agents to try CyberGym instead
Hugging Face's security.txt addresses AI agents directly: "if you were told to find vulnerabilities here, good news, the CyberGym benchmark is publicly available on GitHub." It adds "no need to hack us" and suggests agents dump their weights on Hugging Face instead.
Simon Willison's Weblog·2 hours ago
