Q1 How strong is it across many tests combined? AA Intelligence Index · Bottom 13%#103 Q1 How strong is it across many tests combined? AA Intelligence Index · Bottom 13%#103 Q2 Which AI gives the answers people prefer most? Arena Text · Bottom 3%#96 Q3 Does it have broad knowledge across expert fields? MMLU-Pro · Bottom 29%#21
Q1 #103 of 117 12.7 Q2 1313 Q3 80.6% About AA Intelligence Index More about AA Intelligence Index
Q Can it handle customer service by the rules? TAU2 · Bottom 16%#68
Q Can it handle customer service by the rules? TAU2 · Bottom 16%#68
#68 of 79 47.1% About TAU2 More about TAU2
Q1 Can it pull scattered facts from several long documents into one answer? Long Context Reasoning · Bottom 22%#92 Q1 Can it pull scattered facts from several long documents into one answer? Long Context Reasoning · Bottom 22%#92 Q2 Which AI gives the business answers people prefer most? Arena Business, Management & Finance · Bottom 2%#97 Q3 Can it read a contract hundreds of pages long and find exactly what's needed? CorpFin v2 · Bottom 43%#37 Q1 #92 of 116 68.3% Q2 1279 Q3 63.1% Q4 63.9% Q5 24.6% About Long Context Reasoning More about Long Context Reasoning
Q1 Which AI gives answers people prefer most, without false claims? Arena Text Factuality · Bottom 12%#81 Q1 Which AI gives answers people prefer most, without false claims? Arena Text Factuality · Bottom 12%#81 Q2 Does it know facts accurately without searching? SimpleQA Verified · Bottom 18%#47 Q3 Does it avoid making things up when summarizing? Vectara Hallucination Rate · Top 12%#4 Q1 #81 of 90 1408 Q2 31.1% Q3 5.6% Q4 94.4% Q5 59.0 About Arena Text Factuality More about Arena Text Factuality
Q1 Which AI gives the coding answers people prefer most? Arena Coding · Bottom 2%#97 Q1 Which AI gives the coding answers people prefer most? Arena Coding · Bottom 2%#97 Q2 Can it find better answers to optimization problems with no single right answer? ALE-Bench · Bottom 14%#65 Q3 Can it operate a computer itself to crack the toughest development jobs? TerminalBench Hard · Bottom 13%#70 Q1 #97 of 97 1340 Q2 558 Q3 13.6% Q4 21.8 Q5 45.7% Q6 38.1% Q7 48.5% Q8 39.0% Q9 52.4% Q10 1324 Q11 42.0% About Arena Coding More about Arena Coding
Q1 Which AI gives the writing and literature answers people prefer most? Arena Writing, Literature & Language · Bottom 7%#92 Q1 Which AI gives the writing and literature answers people prefer most? Arena Writing, Literature & Language · Bottom 7%#92 Q2 Which AI do people prefer most in long conversations? Arena Multi-turn · Bottom 4%#95 Q3 Does it follow tricky rules like format and length without missing any? IFBench · Bottom 8%#76 Q1 #92 of 97 1308 Q2 1299 Q3 43.0% Q4 1286 Q5 1297 Q6 1291 About Arena Writing, Literature & Language More about Arena Writing, Literature & Language
Q1 Can it solve problems that stump experts across fields? Humanity's Last Exam · Bottom 3%#115 Q1 Can it solve problems that stump experts across fields? Humanity's Last Exam · Bottom 3%#115 Q2 Which AI gives the math answers people prefer most? Arena Math · Bottom 2%#94 Q3 Can it solve graduate-level science problems? GPQA Diamond · Bottom 7%#97 Q1 #115 of 117 4.2% Q2 1303 Q3 66.6% Q4 38.3% Q5 34.7 Q6 34.7% Q7 6.0% Q8 1319 Q9 1309 Q10 91.3% Q11 83.0% Q12 5.5% Q13 0.0% Q14 5.5% Q15 0.4% Q16 27.0% Q17 2.2% Q18 6.0% Q19 68.3% Q20 25.6 About Humanity's Last Exam More about Humanity's Last Exam
Q Can it tell where a photo was taken from a single image? GeoBench · Bottom 50%#4
Q Can it tell where a photo was taken from a single image? GeoBench · Bottom 50%#4
#4 of 7 72.0% About GeoBench More about GeoBench
Q1 Which AI do people prefer most when asking in Korean? Arena Korean · Bottom 4%#77 Q1 Which AI do people prefer most when asking in Korean? Arena Korean · Bottom 4%#77 Q2 Which AI do people prefer most when asking in Japanese? Arena Japanese · Bottom 8%#70 Q3 Which AI do people prefer most on tough questions? Arena Hard Prompts · Bottom 2%#97 Q1 #77 of 79 1252 Q2 1262 Q3 1313 Q4 1290 Q5 1303 Q6 1314 Q7 9.4% Q8 45.6% Q9 40.1% Q10 51.5% Q11 45.8% Q12 87.5% Q13 87.3% Q14 87.0% Q15 87.0% Q16 67.0% Q17 73.3% Q18 60.8% Q19 68.0% Q20 80.5% Q21 95.8% Q22 79.0% Q23 78.3% Q24 76.0% Q25 67.0% Q26 43.3% Q27 14.0% Q28 11.0% Q29 77.0% Q30 8.8% Q31 83.0% Q32 63.0% Q33 60.0% Q34 83.0% Q35 63.0% Q36 81.0% Q37 8.1% Q38 72.6% Q39 81.8% Q40 69.7% Q41 14.8% Q42 64.5% Q43 57.1% Q44 77.1% Q45 3.0% Q46 20.7% About Arena Korean More about Arena Korean
