Q1 Which AI gives the answers people prefer most? Arena Text · Bottom 16%#92 Q1 Which AI gives the answers people prefer most? Arena Text · Bottom 16%#92 Q2 Does it have broad knowledge across expert fields? MMLU-Pro · Bottom 50%#15 Q3 How high was its intelligence index on the old v4 edition? AA Intelligence Index v4 · Bottom 11%#69
Q1 Bottom 16%#92 of 108 1409 Q2 83.2% Q3 13.1 About Arena Text More about Arena Text
Q1 Can it run a small business alone for a year and make money? Vending-Bench 2 · Bottom 13%#51 Q1 Can it run a small business alone for a year and make money? Vending-Bench 2 · Bottom 13%#51 Q2 Can it handle customer service by the rules? TAU2 · Bottom 8%#74 Q3 Can it find where to click in complex software? ScreenSpot-Pro · Bottom 8%#13
Q1 Bottom 13%#51 of 57 $549 Q2 31.6% Q3 3.9% About Vending-Bench 2 More about Vending-Bench 2
Q1 Can it pull scattered facts from several long documents into one answer? Long Context Reasoning · Bottom 19%#100 Q1 Can it pull scattered facts from several long documents into one answer? Long Context Reasoning · Bottom 19%#100 Q2 Which AI gives the business answers people prefer most? Arena Business, Management & Finance · Bottom 14%#94 Q3 Can it read hospital records and assign the right diagnosis codes? MedCode · Bottom 29%#55
Q1 Bottom 19%#100 of 121 65.3% Q2 1400 Q3 40.4% By effort None 49.9% Thinking 65.3%
About Long Context Reasoning More about Long Context Reasoning
Q1 Which AI gives answers people prefer most, without false claims? Arena Text Factuality · Bottom 28%#76 Q1 Which AI gives answers people prefer most, without false claims? Arena Text Factuality · Bottom 28%#76 Q2 Can it answer questions that need many sources, without missing anything? DeepSearchQA · Bottom 36%#10 Q3 Does it avoid making things up when summarizing? Vectara Hallucination Rate · Top 30%#12 Q1 Bottom 28%#76 of 103 1436 Q2 25.9% Q3 7.8% Q4 92.2% Q5 58.6 About Arena Text Factuality More about Arena Text Factuality
Q1 Which AI do people prefer most for coding answers? Arena Coding · Bottom 11%#98 Q1 Which AI do people prefer most for coding answers? Arena Coding · Bottom 11%#98 Q2 Can it find better answers to optimization problems with no single right answer? ALE-Bench · Bottom 22%#72 Q3 Can it operate a computer itself to crack the toughest development jobs? TerminalBench Hard · Bottom 13%#70 Q1 Bottom 11%#98 of 108 1424 Q2 662 Q3 13.6% Q4 22.2 Q5 69.5% Q6 39.4% Q7 1421 Q8 17.1% About Arena Coding More about Arena Coding
Q1 Which AI gives the writing and literature answers people prefer most? Arena Writing, Literature & Language · Bottom 24%#84 Q1 Which AI gives the writing and literature answers people prefer most? Arena Writing, Literature & Language · Bottom 24%#84 Q2 Which AI do people prefer most in long conversations? Arena Multi-turn · Bottom 14%#94 Q3 Does it follow tricky rules like format and length without missing any? IFBench · Bottom 15%#70 Q1 Bottom 24%#84 of 108 1402 Q2 1403 Q3 50.3% Q4 1394 Q5 1399 Q6 83.0% Q7 1386 About Arena Writing, Literature & Language More about Arena Writing, Literature & Language
Q1 Can it solve problems that stump experts across fields? Humanity's Last Exam · Bottom 15%#105 Q1 Can it solve problems that stump experts across fields? Humanity's Last Exam · Bottom 15%#105 Q2 Can it solve research-level physics problems? CritPt · Bottom 17%#74 Q3 Which AI gives the math answers people prefer most? Arena Math · Bottom 15%#90 Q1 Bottom 15%#105 of 122 12.1% Q2 1.1% Q3 1405 Q4 79.0% Q5 73.3 Q6 73.3% Q7 1430 Q8 1416 Q9 98.1% Q10 4.8% Q11 4.2% Q12 41.2% Q13 76.5% Q14 27.5 By effort None 4.7% Thinking 12.1%
About Humanity's Last Exam More about Humanity's Last Exam
Q1 Which AI gives the photo and chart answers people prefer most? Arena Vision · Bottom 26%#50 Q1 Which AI gives the photo and chart answers people prefer most? Arena Vision · Bottom 26%#50 Q2 Can it rotate and fold objects in its head? SpatialViz-Bench · Top 50%#2 Q3 Can it solve college-level problems with images and diagrams? MMMU-Pro · Bottom 11%#34
Q1 Bottom 26%#50 of 66 1235 Q2 36.9% Q3 66.7% About Arena Vision More about Arena Vision
Q1 Which AI do people prefer most when asking in Korean? Arena Korean · Bottom 22%#72 Q1 Which AI do people prefer most when asking in Korean? Arena Korean · Bottom 22%#72 Q2 Which AI do people prefer most when asking in Japanese? Arena Japanese · Bottom 28%#65 Q3 Which AI do people prefer most on tough questions? Arena Hard Prompts · Bottom 13%#95 Q1 Bottom 22%#72 of 91 1374 Q2 1390 Q3 1419 Q4 1425 Q5 1427 Q6 1426 Q7 33.5% Q8 83.3% Q9 54.4% Q10 70.0% Q11 41.0% Q12 30.7% Q13 60.0% Q14 41.0% Q15 91.5% Q16 91.3% Q17 91.5% Q18 64.2% Q19 77.4% Q20 76.6% Q21 9.1% Q22 69.7% Q23 78.0% Q24 66.5% Q25 28.1% Q26 75.5% Q27 3.0% Q28 24.5% About Arena Korean More about Arena Korean
Q1 Does it call out a nonsense question instead of playing along? BullshitBench v2 · Bottom 24%#110 Q1 Does it call out a nonsense question instead of playing along? BullshitBench v2 · Bottom 24%#110 Q2 Who survives longer in head-to-head snake games? SnakeBench · Top 11%#32
Q1 Bottom 24%#110 of 143 19.0% Q2 31 About BullshitBench v2 More about BullshitBench v2