protologue

IFEval

Also called Instruction-Following Eval.

IFEval (Instruction-Following Eval) is a benchmark of prompts containing instructions whose compliance can be checked automatically, such as "write at least 300 words" or "do not use any commas", used to measure instruction following without a human or model judge.

Description

Verifiable instructions make scoring objective and cheap, which is why IFEval is a common headline score for instruction-tuned models. It measures adherence to format and content constraints, not answer quality.

Sources

  1. Zhou et al. (2023). Instruction-Following Evaluation for Large Language Models.

Cite this entry

Protologue. (2026). IFEval. In Protologue: A Taxonomy of Prompting and LLM Techniques (v1.4.0, PTL-0208). https://protologue.com/t/ifeval/

BibTeX
@misc{protologue_ifeval,
  title = {IFEval},
  author = {{Protologue}},
  year = {2026},
  howpublished = {Protologue: A Taxonomy of Prompting and LLM Techniques, v1.4.0},
  note = {Entry PTL-0208},
  url = {https://protologue.com/t/ifeval/}
}

Markdown JSON