Q1 How strong is it across many tests combined? AA Intelligence Index · Top 41%#47 Q1 How strong is it across many tests combined? AA Intelligence Index · Top 41%#47 Q2 Which AI gives the answers people prefer most? Arena Text · Bottom 33%#66 Q3 Can it solve brand-new problems, not just memorized ones? LiveBench Overall · Bottom 10%#46
Q1 Top 41%#47 of 116 29.2 Q2 1440 Q3 67.3 About AA Intelligence Index More about AA Intelligence Index
Q1 Can it handle customer service by the rules? τ³-Banking · Bottom 38%#50 Q1 Can it handle customer service by the rules? τ³-Banking · Bottom 38%#50 Q2 Can it run a small business alone for a year and make money? Vending-Bench 2 · Bottom 22%#38 Q3 Can it handle customer service by the rules? TAU2 · Top 49%#38 Q1 Bottom 38%#50 of 79 15.3% Q2 $2,158 Q3 88.9% Q4 74.2% Q5 4.6% About τ³-Banking More about τ³-Banking
Q1 Can it pull scattered facts from several long documents into one answer? Long Context Reasoning · Top 14%#15 Q1 Can it pull scattered facts from several long documents into one answer? Long Context Reasoning · Top 14%#15 Q2 Can it read tables and reshape them as needed? LiveBench Data Analysis · Top 44%#22 Q3 Which AI gives the business answers people prefer most? Arena Business, Management & Finance · Bottom 46%#54 Q1 Top 14%#15 of 115 83.0% Q2 76.2 Q3 1448 Q4 37.7% Q5 48.3% Q6 68.1% Q7 49.7% Q8 29.8% Q9 4.2% Q10 46.3% Q11 1435 About Long Context Reasoning More about Long Context Reasoning
Q1 Which AI gives answers people prefer most, without false claims? Arena Text Factuality · Bottom 29%#65 Q1 Which AI gives answers people prefer most, without false claims? Arena Text Factuality · Bottom 29%#65 Q2 Can it track down hard-to-find information on the web? BrowseComp · Top 38%#15
Q1 Bottom 29%#65 of 90 1434 Q2 83.5% About Arena Text Factuality More about Arena Text Factuality
Q1 Can it operate a computer itself to finish hours-long development jobs? Terminal-Bench 4.0 · Bottom 50%#40 Q1 Can it operate a computer itself to finish hours-long development jobs? Terminal-Bench 4.0 · Bottom 50%#40 Q2 Which AI gives the coding answers people prefer most? Arena Coding · Bottom 37%#63 Q3 Can it run and fix code until the task is done? LiveBench Agentic Coding · Bottom 12%#45 Q1 Bottom 50%#40 of 78 2.0% Q2 1494 Q3 40.7 Q4 640 Q5 59.0% Q6 65.2% Q7 42.4% Q8 58.6 Q9 1482 Q10 47.1% Q11 68.2 Q12 80.5% Q13 14.7% Q14 1485 Q15 0.9% Q16 52.6% About Terminal-Bench 4.0 More about Terminal-Bench 4.0
Q1 Which AI gives the writing and literature answers people prefer most? Arena Writing, Literature & Language · Bottom 38%#62 Q1 Which AI gives the writing and literature answers people prefer most? Arena Writing, Literature & Language · Bottom 38%#62 Q2 Which AI do people prefer most in long conversations? Arena Multi-turn · Bottom 40%#60 Q3 Does it follow tricky rules like format and length without missing any? IFBench · Top 3%#2 Q1 Bottom 38%#62 of 97 1422 Q2 1450 Q3 82.9% Q4 1406 Q5 1434 Q6 76.8 Q7 1150 Q8 87.3% Q9 1407 Q10 57.5 About Arena Writing, Literature & Language More about Arena Writing, Literature & Language
Q1 Can it solve problems that stump experts across fields? Humanity's Last Exam · Top 35%#40 Q1 Can it solve problems that stump experts across fields? Humanity's Last Exam · Top 35%#40 Q2 Can it solve research-level physics problems? CritPt · Bottom 35%#52 Q3 Which AI gives the math answers people prefer most? Arena Math · Bottom 30%#67 Q1 Top 35%#40 of 116 39.0% Q2 3.7% Q3 1432 Q4 92.9% Q5 71.1% Q6 77.0 Q7 18.0% Q8 55.0% Q9 1464 Q10 1448 Q11 74.5 Q12 45.8% Q13 14.0% Q14 8.0% Q15 78.9% Q16 33.7 About Humanity's Last Exam More about Humanity's Last Exam
Q1 Which AI gives the photo and chart answers people prefer most? Arena Vision · Bottom 30%#42 Q1 Which AI gives the photo and chart answers people prefer most? Arena Vision · Bottom 30%#42 Q2 Can it solve college-level problems with images and diagrams? MMMU-Pro · Top 46%#17
Q1 Bottom 30%#42 of 58 1254 Q2 78.1% About Arena Vision More about Arena Vision
Q1 Which AI do people prefer most when asking in Korean? Arena Korean · Bottom 26%#60 Q1 Which AI do people prefer most when asking in Korean? Arena Korean · Bottom 26%#60 Q2 Which AI do people prefer most when asking in Japanese? Arena Japanese · Bottom 32%#52 Q3 Which AI do people prefer most on tough questions? Arena Hard Prompts · Bottom 37%#63 Q1 Bottom 26%#60 of 79 1374 Q2 1392 Q3 1463 Q4 1470 Q5 1460 Q6 1439 Q7 97.6% Q8 82.7% Q9 43.8% Q10 80.6% Q11 85.3% Q12 79.0% Q13 75.2% About Arena Korean More about Arena Korean