Q Which AI gives the answers people prefer most? Arena Text · Bottom 15%#93
Q Which AI gives the answers people prefer most? Arena Text · Bottom 15%#93
Bottom 15%#93 of 108 1409 About Arena Text More about Arena Text
Q1 Can it handle customer service by the rules? τ³-Banking · Top 46%#36 Q1 Can it handle customer service by the rules? τ³-Banking · Top 46%#36 Q2 Can it handle customer service by the rules? TAU2 · Top 37%#29
Q1 Top 46%#36 of 79 22.9% Q2 92.7% About τ³-Banking More about τ³-Banking
Q1 Can it pull scattered facts from several long documents into one answer? Long Context Reasoning · Top 41%#49 Q1 Can it pull scattered facts from several long documents into one answer? Long Context Reasoning · Top 41%#49 Q2 Which AI gives the business answers people prefer most? Arena Business, Management & Finance · Bottom 17%#91
Q1 Top 41%#49 of 121 79.0% Q2 1414 About Long Context Reasoning More about Long Context Reasoning
Q1 Which AI gives answers people prefer most, without false claims? Arena Text Factuality · Bottom 42%#61 Q1 Which AI gives answers people prefer most, without false claims? Arena Text Factuality · Bottom 42%#61 Q2 Can it track down hard-to-find information on the web? BrowseComp · Bottom 28%#30
Q1 Bottom 42%#61 of 103 1447 Q2 67.1% About Arena Text Factuality More about Arena Text Factuality
Q1 Can AI carry out long development tasks autonomously by operating a computer itself? Terminal-Bench 4.0 · Bottom 36%#55 Q1 Can AI carry out long development tasks autonomously by operating a computer itself? Terminal-Bench 4.0 · Bottom 36%#55 Q2 Which AI do people prefer most for coding answers? Arena Coding · Bottom 13%#95 Q3 Can it operate a computer itself to finish development jobs on its own? Terminal-Bench 2.1 · Top 47%#38 Q1 Bottom 36%#55 of 84 0.5% Q2 1452 Q3 64.4% Q4 34.1% Q5 58.8 Q6 1359 Q7 48.6% Q8 1445 About Terminal-Bench 4.0 More about Terminal-Bench 4.0
Q1 Which AI gives the writing and literature answers people prefer most? Arena Writing, Literature & Language · Bottom 14%#94 Q1 Which AI gives the writing and literature answers people prefer most? Arena Writing, Literature & Language · Bottom 14%#94 Q2 Which AI do people prefer most in long conversations? Arena Multi-turn · Bottom 19%#89 Q3 Does it follow tricky rules like format and length without missing any? IFBench · Bottom 39%#51 Q1 Bottom 14%#94 of 108 1378 Q2 1416 Q3 63.1% Q4 1355 Q5 1397 Q6 1363 About Arena Writing, Literature & Language More about Arena Writing, Literature & Language
Q1 Can it solve problems that stump experts across fields? Humanity's Last Exam · Bottom 50%#62 Q1 Can it solve problems that stump experts across fields? Humanity's Last Exam · Bottom 50%#62 Q2 Which AI gives the math answers people prefer most? Arena Math · Bottom 27%#77 Q3 Can it solve graduate-level science problems? GPQA Diamond · Top 35%#36 Q1 Bottom 50%#62 of 122 33.5% Q2 1429 Q3 89.7% Q4 84.3% Q5 1431 Q6 1449 About Humanity's Last Exam More about Humanity's Last Exam
Q1 Which AI do people prefer most on tough questions? Arena Hard Prompts · Bottom 17%#91 Q1 Which AI do people prefer most on tough questions? Arena Hard Prompts · Bottom 17%#91 Q2 Which AI do people prefer most on expert-level questions? Arena Expert · Bottom 21%#85 Q3 Which AI gives the medical and health answers people prefer most? Arena Medicine & Healthcare · Bottom 18%#88 Q1 Bottom 17%#91 of 108 1433 Q2 1447 Q3 1424 Q4 1446 Q5 97.1% Q6 84.2% Q7 66.8% Q8 82.0% Q9 87.0% Q10 79.8% Q11 56.8% About Arena Hard Prompts More about Arena Hard Prompts
Q1 Does it call out a nonsense question instead of playing along? BullshitBench v2 · Bottom 21%#114 Q1 Does it call out a nonsense question instead of playing along? BullshitBench v2 · Bottom 21%#114 Q2 Who survives longer in head-to-head snake games? SnakeBench · Top 41%#121
Q1 Bottom 21%#114 of 143 16.0% Reasoning effort: None Q2 24 By effort None 16.0% Extra High 8.0%
About BullshitBench v2 More about BullshitBench v2