LaunchDevelopersJuly 26, 2026

DeepSWE benchmark released with 113 contamination-resistant coding tasks

DeepSWE is a benchmark of 113 software engineering tasks written from scratch to avoid training contamination. Each task is a long-horizon problem from a real open source repo, authored by the repo's maintainer.

People · James Shi

2 sources

More stories today

Open the live feed
DeepSWE benchmark released with 113 contamination-resistant coding tasks