SWE-bench Is Broken: Why a 90% Score Means Almost Nothing
OpenAI stopped reporting SWE-bench Verified after an audit found 138 flawed tasks, over 60% unsolvable. What broke — and what a real benchmark looks like.
Zentask Blog5 min read
1 story
OpenAI stopped reporting SWE-bench Verified after an audit found 138 flawed tasks, over 60% unsolvable. What broke — and what a real benchmark looks like.
Showing 1 of 1 stories
You're all caught up.
Get the top AI news and tools straight to your inbox every week.
Weekly · AI news
Join 15,000+ AI enthusiasts