Q1 How strong is it across many tests combined? AA Intelligence Index · Bottom 6%#111 Q1 How strong is it across many tests combined? AA Intelligence Index · Bottom 6%#111 Q2 Which AI gives the answers people prefer most? Arena Text · Bottom 6%#93 Q3 Does it have broad knowledge across expert fields? MMLU-Pro · Bottom 40%#18
Q1 #111 of 117 10.0 Q2 1327 Q3 80.9% About AA Intelligence Index More about AA Intelligence Index
Q1 Can it handle customer service by the rules? τ³-Banking · Bottom 4%#77 Q1 Can it handle customer service by the rules? τ³-Banking · Bottom 4%#77 Q2 Can it handle customer service by the rules? TAU2 · Bottom 3%#78
Q1 #77 of 79 3.7% Q2 17.8% About τ³-Banking More about τ³-Banking
Q1 Can it pull scattered facts from several long documents into one answer? Long Context Reasoning · Bottom 13%#103 Q1 Can it pull scattered facts from several long documents into one answer? Long Context Reasoning · Bottom 13%#103 Q2 Which AI gives the business answers people prefer most? Arena Business, Management & Finance · Bottom 6%#93 Q3 Can it read a contract hundreds of pages long and find exactly what's needed? CorpFin v2 · Bottom 4%#62 Q1 #103 of 116 50.0% Q2 1317 Q3 49.7% Q4 36.5% Q5 46.2% Q6 3.6% About Long Context Reasoning More about Long Context Reasoning
Q How well can it predict what will happen? ForecastBench Brier Index · Bottom 15%#24
Q How well can it predict what will happen? ForecastBench Brier Index · Bottom 15%#24
#24 of 27 57.1 About ForecastBench Brier Index More about ForecastBench Brier Index
Q1 Can it operate a computer itself to finish hours-long development jobs? Terminal-Bench 4.0 · Bottom 27%#59 Q1 Can it operate a computer itself to finish hours-long development jobs? Terminal-Bench 4.0 · Bottom 27%#59 Q2 Which AI gives the coding answers people prefer most? Arena Coding · Bottom 6%#93 Q3 Can it find better answers to optimization problems with no single right answer? ALE-Bench · Bottom 2%#74 Q1 #59 of 79 0.0% Q2 1373 Q3 173 Q4 7.9% Q5 6.8% Q6 16.3 Q7 39.7% Q8 31.7% Q9 24.5% Q10 15.6% Q11 1358 About Terminal-Bench 4.0 More about Terminal-Bench 4.0
Q1 Which AI gives the writing and literature answers people prefer most? Arena Writing, Literature & Language · Bottom 9%#90 Q1 Which AI gives the writing and literature answers people prefer most? Arena Writing, Literature & Language · Bottom 9%#90 Q2 Which AI do people prefer most in long conversations? Arena Multi-turn · Bottom 8%#91 Q3 Does it follow tricky rules like format and length without missing any? IFBench · Bottom 8%#76 Q1 #90 of 97 1312 Q2 1326 Q3 43.0% Q4 1307 Q5 1314 Q6 6.20 / 10 Q7 54.2% Q8 1296 About Arena Writing, Literature & Language More about Arena Writing, Literature & Language
Q1 Can it solve problems that stump experts across fields? Humanity's Last Exam · Bottom 6%#112 Q1 Can it solve problems that stump experts across fields? Humanity's Last Exam · Bottom 6%#112 Q2 Can it solve research-level physics problems? CritPt · Bottom 9%#72 Q3 Which AI gives the math answers people prefer most? Arena Math · Bottom 4%#92 Q1 #112 of 117 4.9% Q2 0.0% Q3 1316 Q4 67.1% Q5 20.6% Q6 19.3 Q7 19.3% Q8 1342 Q9 1319 Q10 88.9% Q11 73.0% Q12 0.7% Q13 4.4% Q14 0.0% Q15 27.7% Q16 0.6% Q17 61.9% Q18 15.9 About Humanity's Last Exam More about Humanity's Last Exam
Q1 Which AI gives the photo and chart answers people prefer most? Arena Vision · Bottom 4%#57 Q1 Which AI gives the photo and chart answers people prefer most? Arena Vision · Bottom 4%#57 Q2 Can it tell where a photo was taken from a single image? GeoBench · Bottom 43%#5 Q3 Can it rotate and fold objects in its head? SpatialViz-Bench · Bottom 25%#4
Q1 #57 of 58 1142 Q2 52.0% Q3 31.8% About Arena Vision More about Arena Vision
Q1 Which AI do people prefer most when asking in Korean? Arena Korean · Bottom 6%#76 Q1 Which AI do people prefer most when asking in Korean? Arena Korean · Bottom 6%#76 Q2 Which AI do people prefer most when asking in Japanese? Arena Japanese · Bottom 6%#72 Q3 Which AI do people prefer most on tough questions? Arena Hard Prompts · Bottom 6%#93 Q1 #76 of 79 1261 Q2 1258 Q3 1339 Q4 1326 Q5 1344 Q6 1341 Q7 85.9% Q8 59.2% Q9 62.9% Q10 75.7% Q11 58.2% Q12 2.0% Q13 23.7% About Arena Korean More about Arena Korean
