Arena Team Launches Agent Evaluation Leaderboard
- •Arena Team launched a causal leaderboard for AI agents performing real-world software and analysis tasks.
- •GPT 5.5 (High) currently leads the rankings with a 10.66% net improvement in causal evaluation.
- •Platform data from 160,480 tasks shows high usage of bash, file-write, and web search tools.
The Arena Team released the Agent Arena leaderboard on June 4, 2026, to evaluate AI agents performing complex real-world tasks. The leaderboard utilizes a methodology called causal tracing, which assesses agents as multi-component systems. By randomizing component selections, this framework measures causal treatment effects—referred to as "net improvement"—across signals such as task success rates, verbal feedback, and tool usage accuracy. The current leaderboard focuses on orchestrator models, the primary LLMs responsible for tool selection.
Data for the leaderboard is derived from 160,480 Agent Mode tasks recorded over a recent 7-day period. Among these, code writing accounted for 17.5% of tasks, followed by research and lookup at 10.8%, and planning and brainstorming at 10.6%. The platform processed over 2 million structured tool calls in this timeframe, including approximately 936,000 bash commands and 550,000 file-write operations. Analysis showed that 75.6% of sessions utilized at least one tool, while 32% of sessions reached input context lengths of 128k tokens or more by the final turn.
Performance rankings indicate that GPT 5.5 (High) leads the aggregate leaderboard with a net improvement score of 10.66%, followed by Claude Opus 4.7 (Thinking) at 9.47%. The leaderboard aggregates five primary signals: confirmed task success, praise versus complaint ratios, steerability (the agent's ability to execute corrections), bash recovery rates, and tool hallucination frequency. In addition to performance, the team tracks post-deployment session costs to evaluate Pareto optimality, noting that some models incur higher costs due to differences in step-per-turn frequency or user-interaction patterns. The team intends to expand these metrics and refine trace-mining in future updates.