AIME
Also called AIME 2024, AIME 2025, American Invitational Mathematics Examination.
AIME, the American Invitational Mathematics Examination, is a US high-school mathematics competition whose problems, each with an integer answer, are widely used as a benchmark for reasoning models, usually identified by year, as in AIME 2024 or AIME 2025.
Description
Each exam has only 15 problems, so scores are typically averaged over many sampled attempts and vary noticeably between runs. A new exam each year provides problems written after many models' training data was collected, which limits contamination.
Sources
- OpenAI (2024). Learning to reason with LLMs.
- Muennighoff et al. (2025). s1: Simple test-time scaling.
Cite this entry
Protologue. (2026). AIME. In Protologue: A Taxonomy of Prompting and LLM Techniques (v1.4.0, PTL-0199). https://protologue.com/t/aime/
BibTeX
@misc{protologue_aime,
title = {AIME},
author = {{Protologue}},
year = {2026},
howpublished = {Protologue: A Taxonomy of Prompting and LLM Techniques, v1.4.0},
note = {Entry PTL-0199},
url = {https://protologue.com/t/aime/}
}New terms, as they're coined
One email a week with the newest techniques, each defined and sourced like this entry.
Delivered through Beehiiv. Unsubscribe from any issue.