FrontierHarness Eval: 9 agent harnesses, cost per pass varies 17x
FrontierHarness v1.0 benchmarked 9 agent harnesses (Codex, Claude Code, Kimi Code, etc.) on Runta, finding median cost per successful task varies 17x. Claude Code passed 19 tasks but reached $18.34 per task; OpenCode's cost rises to $3.24 when failures are counted.
1 source
Developers by email
Get an email when there's news on Developers
No news that day, no email.
More stories today
- Meta builds AI 'second brain' that learns from experts
- Snowflake shares surge 22% on AI coding momentum
- Gary Marcus critiques Musk's AI prediction shift
- Lutnick says Anthropic has patched relations with US government
- HPE lifts sales forecast on AI server demand