protologue

MATH

Also called MATH dataset, MATH-500.

MATH is a benchmark of 12,500 competition mathematics problems, spanning seven subjects and five difficulty levels, each with a full step-by-step solution.

Description

It is much harder than grade-school arithmetic and was long a key measure of mathematical reasoning. A 500-problem subset, MATH-500, created for research on process supervision, is the version most often reported today.

Sources

  1. Hendrycks et al. (2021). Measuring Mathematical Problem Solving With the MATH Dataset.
  2. Lightman et al. (2023). Let's Verify Step by Step.

Cite this entry

Protologue. (2026). MATH. In Protologue: A Taxonomy of Prompting and LLM Techniques (v1.4.0, PTL-0198). https://protologue.com/t/math-benchmark/

BibTeX
@misc{protologue_math_benchmark,
  title = {MATH},
  author = {{Protologue}},
  year = {2026},
  howpublished = {Protologue: A Taxonomy of Prompting and LLM Techniques, v1.4.0},
  note = {Entry PTL-0198},
  url = {https://protologue.com/t/math-benchmark/}
}

Markdown JSON