Q1 How high is its intelligence index across knowledge work, coding and science? AA Intelligence Index v5 · Bottom 36%#36 Q1 How high is its intelligence index across knowledge work, coding and science? AA Intelligence Index v5 · Bottom 36%#36 Q2 Which AI gives the answers people prefer most? Arena Text · Bottom 40%#66
Q1 Bottom 36%#36 of 54 26.7 Q2 1448 About AA Intelligence Index v5 More about AA Intelligence Index v5
Q1 Can it pull scattered facts from several long documents into one answer? Long Context Reasoning · Bottom 42%#72 Q1 Can it pull scattered facts from several long documents into one answer? Long Context Reasoning · Bottom 42%#72 Q2 Which AI gives the business answers people prefer most? Arena Business, Management & Finance · Bottom 50%#56 Q3 Can it do real work from many different jobs? JobBench · Top 37%#11 Q1 Bottom 42%#72 of 121 74.3% Q2 1454 Q3 61.2% Q4 56.3% Q5 28.5% Q6 38.0% Q7 13.3% Q8 41.1% Q9 63.3% Q10 11.3% About Long Context Reasoning More about Long Context Reasoning
Q1 Which AI gives answers people prefer most, without false claims? Arena Text Factuality · Bottom 46%#57 Q1 Which AI gives answers people prefer most, without false claims? Arena Text Factuality · Bottom 46%#57 Q2 Can it carry out scientists' real research tasks in a terminal? Terminal-Bench-Science 0.1 · Bottom 38%#26
Q1 Bottom 46%#57 of 103 1450 Q2 4.3% About Arena Text Factuality More about Arena Text Factuality
Q1 Can AI carry out long development tasks autonomously by operating a computer itself? Terminal-Bench 4.0 · Top 33%#27 Q1 Can AI carry out long development tasks autonomously by operating a computer itself? Terminal-Bench 4.0 · Top 33%#27 Q2 Which AI do people prefer most for coding answers? Arena Coding · Top 49%#52 Q3 Can it find better answers to optimization problems with no single right answer? ALE-Bench · Top 42%#37 Q1 Top 33%#27 of 84 22.7% Q2 1510 Q3 1244 Q4 1638 Q5 51.3% Q6 1499 Q7 0.5% Q8 79.0% About Terminal-Bench 4.0 More about Terminal-Bench 4.0
Q1 Which AI gives the writing and literature answers people prefer most? Arena Writing, Literature & Language · Bottom 32%#75 Q1 Which AI gives the writing and literature answers people prefer most? Arena Writing, Literature & Language · Bottom 32%#75 Q2 Which AI do people prefer most in long conversations? Arena Multi-turn · Bottom 35%#72 Q3 Which AI writes the creative pieces people prefer most? Arena Creative Writing · Bottom 25%#83 Q1 Bottom 32%#75 of 108 1416 Q2 1446 Q3 1394 Q4 1435 Q5 85.3% Q6 1407 About Arena Writing, Literature & Language More about Arena Writing, Literature & Language
Q1 Can it solve problems that stump experts across fields? Humanity's Last Exam · Top 46%#56 Q1 Can it solve problems that stump experts across fields? Humanity's Last Exam · Top 46%#56 Q2 Can it solve research-level physics problems? CritPt · Bottom 49%#46 Q3 Which AI gives the math answers people prefer most? Arena Math · Top 50%#51 Q1 Top 46%#56 of 122 35.1% Q2 12.0% Q3 1463 Q4 63.0% Q5 1462 Q6 1479 About Humanity's Last Exam More about Humanity's Last Exam
Q Which AI gives the photo and chart answers people prefer most? Arena Vision · Bottom 38%#42
Q Which AI gives the photo and chart answers people prefer most? Arena Vision · Bottom 38%#42
Bottom 38%#42 of 66 1258 About Arena Vision More about Arena Vision
Q1 Which AI do people prefer most when asking in Korean? Arena Korean · Bottom 41%#55 Q1 Which AI do people prefer most when asking in Korean? Arena Korean · Bottom 41%#55 Q2 Which AI do people prefer most when asking in Japanese? Arena Japanese · Bottom 25%#67 Q3 Which AI do people prefer most on tough questions? Arena Hard Prompts · Bottom 41%#65 Q1 Bottom 41%#55 of 91 1408 Q2 1378 Q3 1472 Q4 1490 Q5 1458 Q6 1442 Q7 95.1% Q8 50.9 About Arena Korean More about Arena Korean