MATH Level 5
Citation frequency 1/3Saturated
- What does it measure?
- Tests math problem solving on only the hardest tier (level 5) of MATH, a collection of high-school competition problems.
- Who evaluates it, and how?
- 1,324 level-5 problems from the MATH test set. Grading uses the final answer, not the working, and a match is checked by string comparison, mathematical equivalence, or an AI judge.
- Reading the score
- Scores run from 0 to 100%. Higher is better. Recent models mostly score high, so the top models are hard to tell apart.
Top score98.1%
Models tested10
Scoring basisHigher is better
Last updated2025.10.30
Model release date
RankModelSettingReleasedPrice/1MScore
- 1high2025.08.07$7.8198.1%
- 2high2025.08.07$1.5697.8%
- 3budget-32K2025.09.29$1297.7%
- 4budget-32K2025.10.15$496.4%
- 5medium2025.08.07$0.3195.2%
- 62025.05.22$6085.0%
- 72025.05.22$1284.4%
- 82025.04.14$6.5083.0%
- 92025.04.05$0.8473.0%
- 102025.04.05$0.2562.3%
The "harness" is the agent program the AI used to carry out the task. The same model can score very differently depending on its harness and reasoning effort.