Research

SWE-Bench Pro audit conducted using model-based agents and a combination of five independent engineers

The SWE-Bench Pro audit was conducted using model-based investigative agents and individual reviews by five independent, experienced software engineers to examine a larger number of tasks in a…

SWE-Bench Pro audit conducted using model-based agents and a combination of five independent engineers

The SWE-Bench Pro audit was conducted using model-based investigative agents and individual reviews by five independent, experienced software engineers to examine a larger number of tasks in a scalable manner while keeping expert judgment central.