Q1 How strong is it across many tests combined? AA Intelligence Index · Bottom 12%#105 Q1 How strong is it across many tests combined? AA Intelligence Index · Bottom 12%#105 Q2 Which AI gives the answers people prefer most? Arena Text · Bottom 32%#67
Q1 #105 of 117 11.5 Q2 1437 About AA Intelligence Index More about AA Intelligence Index
Q Can it handle customer service by the rules? TAU2 · Bottom 37%#51
Q Can it handle customer service by the rules? TAU2 · Bottom 37%#51
#51 of 79 79.5% About TAU2 More about TAU2
Q1 Can it pull scattered facts from several long documents into one answer? Long Context Reasoning · Bottom 5%#112 Q1 Can it pull scattered facts from several long documents into one answer? Long Context Reasoning · Bottom 5%#112 Q2 Which AI gives the business answers people prefer most? Arena Business, Management & Finance · Bottom 29%#70
Q1 #112 of 116 28.3% Q2 1433 About Long Context Reasoning More about Long Context Reasoning
Q Which AI gives answers people prefer most, without false claims? Arena Text Factuality · Bottom 23%#71
Q Which AI gives answers people prefer most, without false claims? Arena Text Factuality · Bottom 23%#71
#71 of 90 1429 About Arena Text Factuality More about Arena Text Factuality
Q1 Which AI gives the coding answers people prefer most? Arena Coding · Bottom 44%#56 Q1 Which AI gives the coding answers people prefer most? Arena Coding · Bottom 44%#56 Q2 Can it operate a computer itself to crack the toughest development jobs? TerminalBench Hard · Bottom 8%#74 Q3 How strong is its overall coding? AA Coding Index · Bottom 9%#92 Q1 #56 of 97 1501 Q2 10.6% Q3 16.5 Q4 28.4% Q5 1489 About Arena Coding More about Arena Coding
Q1 Which AI gives the writing and literature answers people prefer most? Arena Writing, Literature & Language · Bottom 20%#79 Q1 Which AI gives the writing and literature answers people prefer most? Arena Writing, Literature & Language · Bottom 20%#79 Q2 Which AI do people prefer most in long conversations? Arena Multi-turn · Bottom 27%#72 Q3 Does it follow tricky rules like format and length without missing any? IFBench · Bottom 9%#75 Q1 #79 of 97 1392 Q2 1432 Q3 43.1% Q4 1390 Q5 1416 Q6 1397 About Arena Writing, Literature & Language More about Arena Writing, Literature & Language
Q1 Can it solve problems that stump experts across fields? Humanity's Last Exam · Bottom 7%#110 Q1 Can it solve problems that stump experts across fields? Humanity's Last Exam · Bottom 7%#110 Q2 Which AI gives the math answers people prefer most? Arena Math · Bottom 33%#64 Q3 Can it solve graduate-level science problems? GPQA Diamond · Bottom 5%#99 Q1 #110 of 117 5.8% Q2 1435 Q3 63.6% Q4 1455 Q5 1440 About Humanity's Last Exam More about Humanity's Last Exam
Q1 Which AI do people prefer most when asking in Korean? Arena Korean · Bottom 33%#54 Q1 Which AI do people prefer most when asking in Korean? Arena Korean · Bottom 33%#54 Q2 Which AI do people prefer most when asking in Japanese? Arena Japanese · Bottom 30%#54 Q3 Which AI do people prefer most on tough questions? Arena Hard Prompts · Bottom 33%#66 Q1 #54 of 79 1386 Q2 1390 Q3 1461 Q4 1468 Q5 1460 Q6 1429 About Arena Korean More about Arena Korean
