FrontierCode
Widely citedHigher is better
Made by Cognition: for 150 hard issues from real open-source repositories, the agent must produce a fix good enough to merge. Grading covers behavior, not breaking existing features, build quality, and project conventions; the score is the average of five attempts on the 100 hardest tasks. Scores run from 0 to 100%. Higher is better.
Top score54.6%Claude Opus 5.5
Models tested36
Model release date (newest on the right)
Best score so farHigher on the chart is better
Can it operate a computer itself to finish hours-long development jobs?Terminal-Bench 4.0
Claude Sonnet 5.5🥇
Claude Sonnet 5.5🥇Which AI gives the coding answers people prefer most?Arena Coding
Gemini 4 Argon🥇
Gemini 4 Argon🥇Can it run and fix code until the task is done?LiveBench Agentic Coding
DeepSeek V4.1 Flash🥇
DeepSeek V4.1 Flash🥇
- 🥇AnthropicClaude Opus 5.5Reasoning effort: Medium54.6%
- 🥈AnthropicClaude Fable 553.5%
- 🥉AnthropicClaude Opus 5Reasoning effort: Max53.4%
- #4OpenAIGPT-6 AstraReasoning effort: Max53.3%
- #5AnthropicClaude Sonnet 5.5Reasoning effort: Extra High52.1%
- #6AnthropicClaude Fable 5.1Reasoning effort: Medium50.9%
- #7OpenAIGPT-6.1 SolReasoning effort: Medium50.2%
- #8OpenAIGPT-6 SolReasoning effort: Max49.3%
- #9xAIGrok 4.648.0%
- #10xAIGrok 4.747.6%
- #11OpenAIGPT-5.6 Sol47.5%
- #12AnthropicClaude Opus 4.846.5%
- #13Moonshot AIKimi K344.2%
- #14GoogleGemini 3.7 Flash43.6%
- #15OpenAIGPT-5.543.0%
- #16AnthropicClaude Sonnet 542.7%
- #17xAIGrok 4.542.4%
- #18OpenAIGPT-6 LunaReasoning effort: Max42.4%
- #19OpenAIGPT-5.6 Terra41.3%
- #20GoogleGemini 3.8 FlashReasoning effort: Medium41.2%
- #21Z.aiGLM 5.3Reasoning effort: Max40.1%
- #22OpenAIGPT-5.6 Luna39.8%
- #23AnthropicClaude Opus 4.738.5%
- #24GoogleGemini 3.6 Flash34.4%
- #25Z.aiGLM 5.3 FlashReasoning effort: Max31.8%
- #26Moonshot AIKimi K2.7 Code30.1%
- #27DeepSeekDeepSeek V4 ProReasoning effort: High28.5%
- #28OpenAIGPT-5.4 Mini27.0%
- #29AnthropicClaude Opus 4.626.6%
- #30Z.aiGLM 5.2Reasoning effort: None24.5%
- #31AnthropicClaude Sonnet 4.624.3%
- #32DeepSeekDeepSeek V4 Flash18.8%
- #33MiniMaxMiniMax M314.7%
- #34NVIDIANemotron 3 Ultra13.6%
- #35AlibabaQwen3.7 Plus10.2%
- #36Mistral AIMistral Medium 3.58.0%
Half of models ≤ 41.9%Last updated 2026-10-07
The "harness" is the agent program the AI used to carry out the task. The same model can score very differently depending on its harness and reasoning effort.