protologue

Embedding

Also called text embedding, vector embedding, embedding vector.

An embedding is a fixed-length vector of numbers that represents a piece of text, or another input, so that inputs with similar meaning have vectors that are close together, typically measured by cosine similarity.

Description

Embeddings are produced by an embedding model, which is usually separate from the generating model. They underpin semantic search, dense retrieval for RAG, clustering, deduplication, and the selection of similar few-shot examples. Quality depends on the embedding model and on how text is chunked, and embeddings capture topical similarity better than exact facts such as numbers, names, or negation.

Sources

  1. Reimers and Gurevych (2019). Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks.
  2. Karpukhin et al. (2020). Dense Passage Retrieval for Open-Domain Question Answering.

Cite this entry

Protologue. (2026). Embedding. In Protologue: A Taxonomy of Prompting and LLM Techniques (v1.4.0, PTL-0123). https://protologue.com/t/embedding/

BibTeX
@misc{protologue_embedding,
  title = {Embedding},
  author = {{Protologue}},
  year = {2026},
  howpublished = {Protologue: A Taxonomy of Prompting and LLM Techniques, v1.4.0},
  note = {Entry PTL-0123},
  url = {https://protologue.com/t/embedding/}
}

Markdown JSON