Sierra open-sources τ^τ-bench for agent construction
τ^τ-bench evaluates coding agents on building real-world customer-service agents from business records, client requirements, and production APIs, revealing substantial gaps versus expert performance. Sierra open-sourced the benchmark yesterday.
2 sources
More stories today
OpenAI uses its models to fix critical vulnerabilities in own systems
Greg Brockman·34 minutes ago
Users debate letting Claude agents handle email
Reddit users discuss whether they trust Claude or other AI agents to triage real email inboxes, citing concerns about accuracy over time and the need to double-check filings. Few report letting agents fully manage email.
r/ClaudeAI·35 minutes ago
Terence Tao warns AI is depleting math's open problems
Terence Tao, a Fields Medalist, argues AI is solving fruitful open math problems faster than mathematicians can identify new ones. He suggests labeling problems "analysis-required" so bare AI answers without reasoning count for little.
Decrypt·54 minutes ago
AI Models by email
Get an email when there's news on AI Models
No news that day, no email.
NVIDIA Dynamo EPD disaggregation speeds multimodal serving up to 5x
NVIDIA's blog details EPD disaggregation for multimodal inference, claiming up to 5x faster time-to-first-token and 7x faster end-to-end response. It separates vision encoding from prefill/decode, best for image-heavy prompts and quantized MoE models.
NVIDIA Developer Blog·54 minutes ago
CUDA Toolkit 13.4 adds Windows on Arm support, Rubin preview
CUDA Toolkit 13.4 adds Windows on Arm support and early developer preview of the NVIDIA Rubin GPU architecture (compute capability 107). It also introduces MPS V3 with scriptable CLI, namespaces, and cgroup-integrated memory limits for shared GPU management.
Perplexity introduces Q2D-Web benchmark for agentic RAG retrieval
Perplexity AI·1 hour agoNew skills for interface review, typography, accessibility in Claude Code
Tom Doerr·1 hour ago
Claude tops new benchmark for agents that build agents, still fails most tests
On a new benchmark for AI agents that build other agents, Claude performed best but still passed fewer than a quarter of the tests. The benchmark, reported by The New Stack, highlights the difficulty of automating agent development.
The New Stack·1 hour ago
