protologue

Chunking

Also called document chunking, text splitting, passage segmentation, late chunking.

Chunking is splitting documents into smaller passages before indexing them for retrieval, so that each retrieved unit is small enough to fit the context and focused enough to match a query.

Description

Chunk size and overlap are the main levers. Chunks that are too large dilute the embedding and waste context, while chunks that are too small lose the surrounding meaning. Common strategies split by fixed token counts, by document structure such as headings and paragraphs, or by meaning. Research has found that retrieving finer units, such as self-contained propositions, can improve retrieval, and approaches such as contextual retrieval and late chunking restore context that splitting removes.

Sources

  1. Chen et al. (2023). Dense X Retrieval: What Retrieval Granularity Should We Use?.
  2. Günther et al. (2024). Late Chunking: Contextual Chunk Embeddings Using Long-Context Embedding Models.

Cite this entry

Protologue. (2026). Chunking. In Protologue: A Taxonomy of Prompting and LLM Techniques (v1.4.0, PTL-0125). https://protologue.com/t/chunking/

BibTeX
@misc{protologue_chunking,
  title = {Chunking},
  author = {{Protologue}},
  year = {2026},
  howpublished = {Protologue: A Taxonomy of Prompting and LLM Techniques, v1.4.0},
  note = {Entry PTL-0125},
  url = {https://protologue.com/t/chunking/}
}

Markdown JSON