Reddit user reports Ox Alpha hits 96% on SWE-bench Verified Mini

A Reddit user benchmarked Ox Alpha on SWE-bench Verified Mini (50 tasks) using the official mini-swe-agent scaffold, achieving 48/50 (96%) resolved. The user expresses skepticism about the result, noting it seems too good to be true.
1 source
Daily brief
Get tomorrow's AI brief in your inbox
More stories today
- Stability AI raises $232M backed by music and gaming giants
- OpenAI's Jalapeño chip beats Nvidia in inference benchmarks
- a16z podcast explores AI's impact on computing's evolution
- AI adoption lags in legal due to fragmented data foundations
- Bain & Company joins Claude Partner Network as Global Premier partner