Q1 How strong is it across many tests combined? AA Intelligence Index · Bottom 18%#97 Q1 How strong is it across many tests combined? AA Intelligence Index · Bottom 18%#97 Q2 Which AI gives the answers people prefer most? Arena Text · Top 28%#27
Q1 Bottom 18%#97 of 117 14.2 Reasoning effort: None Q2 1475 About AA Intelligence Index More about AA Intelligence Index
Q Can it handle customer service by the rules? TAU2 · Bottom 19%#65
Q Can it handle customer service by the rules? TAU2 · Bottom 19%#65
Bottom 19%#65 of 79 59.9% Reasoning effort: None About TAU2 More about TAU2
Q1 Can it pull scattered facts from several long documents into one answer? Long Context Reasoning · Bottom 3%#114 Q1 Can it pull scattered facts from several long documents into one answer? Long Context Reasoning · Bottom 3%#114 Q2 Which AI gives the business answers people prefer most? Arena Business, Management & Finance · Top 29%#28
Q1 Bottom 3%#114 of 116 23.3% Reasoning effort: None Q2 1470 About Long Context Reasoning More about Long Context Reasoning
Q1 Which AI gives answers people prefer most, without false claims? Arena Text Factuality · Top 50%#45 Q1 Which AI gives answers people prefer most, without false claims? Arena Text Factuality · Top 50%#45 Q2 Which AI gives the search answers people prefer most? Arena Search · Bottom 29%#6 Q3 How well can it predict what will happen? ForecastBench Brier Index · Top 8%#2
Q1 Top 50%#45 of 90 1452 Q2 1189 Q3 61.7 About Arena Text Factuality More about Arena Text Factuality
Q1 Which AI gives the coding answers people prefer most? Arena Coding · Top 49%#47 Q1 Which AI gives the coding answers people prefer most? Arena Coding · Top 49%#47 Q2 Can it operate a computer itself to crack the toughest development jobs? TerminalBench Hard · Bottom 16%#68 Q3 How strong is its overall coding? AA Coding Index · Bottom 12%#89 Q1 Top 49%#47 of 97 1508 Q2 16.7% Q3 22.0 Q4 32.8% Q5 1504 About Arena Coding More about Arena Coding
Q1 Which AI gives the writing and literature answers people prefer most? Arena Writing, Literature & Language · Top 37%#35 Q1 Which AI gives the writing and literature answers people prefer most? Arena Writing, Literature & Language · Top 37%#35 Q2 Which AI do people prefer most in long conversations? Arena Multi-turn · Top 25%#24 Q3 Does it follow tricky rules like format and length without missing any? IFBench · Bottom 14%#71 Q1 Top 37%#35 of 97 1452 Q2 1483 Q3 49.3% Q4 1463 Q5 1450 Q6 1449 About Arena Writing, Literature & Language More about Arena Writing, Literature & Language
Q1 Can it solve problems that stump experts across fields? Humanity's Last Exam · Bottom 40%#72 Q1 Can it solve problems that stump experts across fields? Humanity's Last Exam · Bottom 40%#72 Q2 Which AI gives the math answers people prefer most? Arena Math · Bottom 47%#51 Q3 Can it solve graduate-level science problems? GPQA Diamond · Bottom 18%#86 Q1 Bottom 40%#72 of 117 27.9% Reasoning effort: None Q2 1449 Q3 77.6% Q4 1479 Q5 1455 About Humanity's Last Exam More about Humanity's Last Exam
Q1 Which AI do people prefer most when asking in Korean? Arena Korean · Top 23%#18 Q1 Which AI do people prefer most when asking in Korean? Arena Korean · Top 23%#18 Q2 Which AI do people prefer most when asking in Japanese? Arena Japanese · Top 18%#13 Q3 Which AI do people prefer most on tough questions? Arena Hard Prompts · Top 42%#40 Q1 Top 23%#18 of 79 1444 Q2 1478 Q3 1487 Q4 1476 Q5 1498 Q6 1468 Q7 10.0% About Arena Korean More about Arena Korean