Harness engineering emerges as key to AI coding agent performance
Behavioral evaluations and harness design are gaining attention as critical to agent performance. A New Stack analysis found token use varied 70-fold across Aider, Claude Code, and OpenClaw running the same model. YC Paper Club notes the same model scores 30% on ARC-AGI but 95% with a better harness.
How this story unfolded
2 weeks · 6 reports · 4 community posts · from Aug 27
- Aug 27
- Aug 28
- Aug 29
- Aug 30
- Sep 3
- Sep 7
- Sep 9
More stories today
OpenAI uses its models to fix critical vulnerabilities in own systems
Greg Brockman·33 minutes ago
Users debate letting Claude agents handle email
Reddit users discuss whether they trust Claude or other AI agents to triage real email inboxes, citing concerns about accuracy over time and the need to double-check filings. Few report letting agents fully manage email.
r/ClaudeAI·33 minutes ago
Terence Tao warns AI is depleting math's open problems
Terence Tao, a Fields Medalist, argues AI is solving fruitful open math problems faster than mathematicians can identify new ones. He suggests labeling problems "analysis-required" so bare AI answers without reasoning count for little.
Decrypt·52 minutes ago
Google DeepMind by email
Get an email when Google DeepMind has news
No news that day, no email.
NVIDIA Dynamo EPD disaggregation speeds multimodal serving up to 5x
NVIDIA's blog details EPD disaggregation for multimodal inference, claiming up to 5x faster time-to-first-token and 7x faster end-to-end response. It separates vision encoding from prefill/decode, best for image-heavy prompts and quantized MoE models.
NVIDIA Developer Blog·53 minutes ago
CUDA Toolkit 13.4 adds Windows on Arm support, Rubin preview
CUDA Toolkit 13.4 adds Windows on Arm support and early developer preview of the NVIDIA Rubin GPU architecture (compute capability 107). It also introduces MPS V3 with scriptable CLI, namespaces, and cgroup-integrated memory limits for shared GPU management.
Perplexity introduces Q2D-Web benchmark for agentic RAG retrieval
Perplexity AI·1 hour agoNew skills for interface review, typography, accessibility in Claude Code
Tom Doerr·1 hour ago
Claude tops new benchmark for agents that build agents, still fails most tests
On a new benchmark for AI agents that build other agents, Claude performed best but still passed fewer than a quarter of the tests. The benchmark, reported by The New Stack, highlights the difficulty of automating agent development.
The New Stack·1 hour ago
