protologue

RAG Evaluation

Also called Ragas, RAG metrics, faithfulness, context relevance.

RAG evaluation measures a retrieval-augmented system's retrieval and generation separately, typically checking whether the retrieved context is relevant, whether the answer is faithful to that context, and whether the answer addresses the question.

Description

Separating the stages shows whether a bad answer came from retrieval or from generation. Frameworks such as Ragas compute these metrics automatically with an LLM, without reference answers, which makes it practical to compare chunking, retrieval, and prompt choices.

Sources

  1. Es et al. (2023). Ragas: Automated Evaluation of Retrieval Augmented Generation.

Cite this entry

Protologue. (2026). RAG Evaluation. In Protologue: A Taxonomy of Prompting and LLM Techniques (v1.4.0, PTL-0181). https://protologue.com/t/rag-evaluation/

BibTeX
@misc{protologue_rag_evaluation,
  title = {RAG Evaluation},
  author = {{Protologue}},
  year = {2026},
  howpublished = {Protologue: A Taxonomy of Prompting and LLM Techniques, v1.4.0},
  note = {Entry PTL-0181},
  url = {https://protologue.com/t/rag-evaluation/}
}

Markdown JSON