Why we no longer evaluate SWE-bench Verified
SWE-bench Verified is increasingly contaminated and mismeasures frontier coding progress. Our analysis shows flawed tests and training leakage. We recommend SWE-bench Pro.
TopicsAI Search
Related
G
articleOpenAI
GPT-5 System Card
OpenAI
This GPT-5 system card explains how a unified model routing system powers fast and smart responses using gpt-5-main, gpt-5-thinking, and lightweight versions like gpt-5-thinking-nano, optimized for different tasks and developer use.
H
articleOpenAI
Helping disaster response teams turn AI into action across Asia
OpenAI
AI for Disaster Response in Asia: OpenAI Workshop with Gates Foundation
A
articleOpenAI
How Amgen uses GPT-5
OpenAI
Learn how Amgen uses GPT-5.
O
articleOpenAI
OpenAI announces Frontier Alliance Partners
OpenAI
OpenAI announces Frontier Alliance Partners to help enterprises move from AI pilots to production with secure, scalable agent deployments.
E
articleOpenAI
EMEA Youth & Wellbeing Grant
OpenAI
Apply for the EMEA Youth & Wellbeing Grant, a €500,000 program funding NGOs and researchers advancing youth safety and wellbeing in the age of AI.
R
articleOpenAI
A research agenda for assessing the economic impacts of code generation models
OpenAI