Braintrust talk: Agent evals lag behind model evolution
Ameya Bhatawdekar traces five generations of agent architecture, arguing that orchestration graphs built for 2024 models now hold back agents as models learned to orchestrate. He calls for evals to evolve in step with agent capabilities.
Featured · Ameya Bhatawdekar
1 source
Daily brief
Get tomorrow's AI brief in your inbox
More stories today
- How to audit preference biases and fine-tune with DPO (TRL + LoRA)
- Hays Shifts to Hard-to-Replace Roles as AI Reshapes Hiring
- Three.js skill collection enhances Claude Code
- US agencies warn hackers using AI to target Siemens PLCs
- Opus 5 criticized for verbose output as Anthropic reportedly listens