Q1 How strong is it across many tests combined? AA Intelligence Index · Bottom 4%#114 Q1 How strong is it across many tests combined? AA Intelligence Index · Bottom 4%#114 Q2 Which AI gives the answers people prefer most? Arena Text · Bottom 5%#94 Q3 Does it have broad knowledge across expert fields? MMLU-Pro · Bottom 15%#25
Q1 #114 of 117 8.1 Q2 1322 Q3 75.2% About AA Intelligence Index More about AA Intelligence Index
Q1 Can it handle customer service by the rules? τ³-Banking · Bottom 3%#78 Q1 Can it handle customer service by the rules? τ³-Banking · Bottom 3%#78 Q2 Can it handle customer service by the rules? TAU2 · Bottom 2%#79
Q1 #78 of 79 3.3% Q2 15.5% About τ³-Banking More about τ³-Banking
Q1 Can it pull scattered facts from several long documents into one answer? Long Context Reasoning · Bottom 4%#113 Q1 Can it pull scattered facts from several long documents into one answer? Long Context Reasoning · Bottom 4%#113 Q2 Which AI gives the business answers people prefer most? Arena Business, Management & Finance · Bottom 4%#95 Q3 Can it read a contract hundreds of pages long and find exactly what's needed? CorpFin v2 · Bottom 2%#63 Q1 #113 of 116 27.7% Q2 1316 Q3 46.8% Q4 23.3% Q5 36.0% About Long Context Reasoning More about Long Context Reasoning
Q How well can it predict what will happen? ForecastBench Brier Index · Bottom 4%#27
Q How well can it predict what will happen? ForecastBench Brier Index · Bottom 4%#27
#27 of 27 53.7 About ForecastBench Brier Index More about ForecastBench Brier Index
Q1 Can it operate a computer itself to finish hours-long development jobs? Terminal-Bench 4.0 · Bottom 27%#59 Q1 Can it operate a computer itself to finish hours-long development jobs? Terminal-Bench 4.0 · Bottom 27%#59 Q2 Which AI gives the coding answers people prefer most? Arena Coding · Bottom 5%#94 Q3 Can it operate a computer itself to finish development jobs on its own? Terminal-Bench 2.1 · Bottom 4%#79 Q1 #59 of 79 0.0% Q2 1362 Q3 3.7% Q4 1.5% Q5 8.2 Q6 29.9% Q7 21.3% Q8 1349 About Terminal-Bench 4.0 More about Terminal-Bench 4.0
Q1 Which AI gives the writing and literature answers people prefer most? Arena Writing, Literature & Language · Bottom 6%#93 Q1 Which AI gives the writing and literature answers people prefer most? Arena Writing, Literature & Language · Bottom 6%#93 Q2 Which AI do people prefer most in long conversations? Arena Multi-turn · Bottom 5%#94 Q3 Does it follow tricky rules like format and length without missing any? IFBench · Bottom 4%#79 Q1 #93 of 97 1305 Q2 1319 Q3 39.5% Q4 1289 Q5 1299 Q6 50.6% Q7 1289 About Arena Writing, Literature & Language More about Arena Writing, Literature & Language
Q1 Can it solve problems that stump experts across fields? Humanity's Last Exam · Bottom 2%#116 Q1 Can it solve problems that stump experts across fields? Humanity's Last Exam · Bottom 2%#116 Q2 Can it solve research-level physics problems? CritPt · Bottom 9%#72 Q3 Which AI gives the math answers people prefer most? Arena Math · Bottom 3%#93 Q1 #116 of 117 3.8% Q2 0.0% Q3 1309 Q4 58.7% Q5 7.8% Q6 14.0 Q7 14.0% Q8 1334 Q9 1314 Q10 84.4% Q11 62.3% Q12 0.0% Q13 0.5% Q14 0.0% Q15 57.9% Q16 12.0 About Humanity's Last Exam More about Humanity's Last Exam
Q1 Which AI gives the photo and chart answers people prefer most? Arena Vision · Bottom 2%#58 Q1 Which AI gives the photo and chart answers people prefer most? Arena Vision · Bottom 2%#58 Q2 Can it rotate and fold objects in its head? SpatialViz-Bench · Bottom 50%#3
Q1 #58 of 58 1118 Q2 34.2% About Arena Vision More about Arena Vision
Q1 Which AI do people prefer most when asking in Korean? Arena Korean · Bottom 8%#74 Q1 Which AI do people prefer most when asking in Korean? Arena Korean · Bottom 8%#74 Q2 Which AI do people prefer most when asking in Japanese? Arena Japanese · Bottom 7%#71 Q3 Which AI do people prefer most on tough questions? Arena Hard Prompts · Bottom 5%#94 Q1 #74 of 79 1270 Q2 1260 Q3 1329 Q4 1309 Q5 1341 Q6 1341 Q7 82.4% Q8 57.9% Q9 63.2% Q10 61.1% Q11 61.0% Q12 72.8% Q13 58.0% Q14 14.8% Q15 56.3% Q16 48.2% Q17 62.9% Q18 3.0% Q19 16.3% About Arena Korean More about Arena Korean
