protologue

HellaSwag

HellaSwag is a commonsense reasoning benchmark in which a model must pick the most plausible continuation of a description of an everyday situation from four options, with wrong options generated and filtered to fool models.

Description

When it was introduced, the questions were trivial for people but hard for the best models. Modern models score close to human level, so it is a standard example of a saturated benchmark, though it still appears in model reports.

Sources

  1. Zellers et al. (2019). HellaSwag: Can a Machine Really Finish Your Sentence?.

Cite this entry

Protologue. (2026). HellaSwag. In Protologue: A Taxonomy of Prompting and LLM Techniques (v1.4.0, PTL-0195). https://protologue.com/t/hellaswag/

BibTeX
@misc{protologue_hellaswag,
  title = {HellaSwag},
  author = {{Protologue}},
  year = {2026},
  howpublished = {Protologue: A Taxonomy of Prompting and LLM Techniques, v1.4.0},
  note = {Entry PTL-0195},
  url = {https://protologue.com/t/hellaswag/}
}

Markdown JSON