protologue

GAIA

GAIA is a benchmark for general AI assistants made of questions that are conceptually simple for people but require several steps of web browsing, file reading, multimodal understanding, and tool use to answer.

Description

Each question has a single short answer, which makes grading exact despite the open-ended process. It contrasts with benchmarks of expert knowledge by testing whether assistants can reliably carry out ordinary multi-step tasks.

Sources

  1. Mialon et al. (2023). GAIA: a benchmark for General AI Assistants.

Cite this entry

Protologue. (2026). GAIA. In Protologue: A Taxonomy of Prompting and LLM Techniques (v1.4.0, PTL-0206). https://protologue.com/t/gaia/

BibTeX
@misc{protologue_gaia,
  title = {GAIA},
  author = {{Protologue}},
  year = {2026},
  howpublished = {Protologue: A Taxonomy of Prompting and LLM Techniques, v1.4.0},
  note = {Entry PTL-0206},
  url = {https://protologue.com/t/gaia/}
}

Markdown JSON