Arena Math

In plain words · Which AI people preferred for math questions

What does it measure?

Preference on maths questions (calculation, worked solutions, proofs). Because people choose rather than checking against an answer key, solutions that are easy to read have an advantage.

Who evaluates it, and how?

On Arena Intelligence, a user enters a question, two anonymous AIs answer, and the user votes for the better one. Over 82 million votes are aggregated with a statistical model (Bradley-Terry) into an Elo-style score, and this table takes the 'style-controlled' version from the official dataset, which statistically removes the bias toward long, nicely formatted answers. An AI classifier selects prompts that actively apply mathematical concepts — calculations and derivations.

Reading the score

This is a head-to-head record, not an exam score (accuracy %). It is computed from the probability of being preferred over other AIs, so there is no maximum, and when a new AI enters, existing scores shift slightly. Typical values are 1,000–1,500; a 100-point gap means the leader is preferred about 64% of the time, a 200-point gap about 76%. Correctness is not counted — a wrong but friendly answer can win — so if accuracy matters, also look at accuracy tests (GPQA, AIME, etc.). Gaps of a few dozen points are effectively the same tier even if the rank differs. It measures something different from accuracy tests (AIME, MATH-500): not whether the answer was right, but whether people liked it.

Last updated: 2026-10-02