# Multimodal Prompting

> Multimodal prompting is prompting a model with more than one kind of input, such as images, documents, audio, or video together with text, so the model reasons over all of them.

- Identifier: PTL-0111
- Category: Foundations
- Canonical URL: https://protologue.com/t/multimodal-prompting/
- Also known as: vision prompting, image prompting, visual prompting
- Introduced: 2023

## Description

Text-prompting techniques largely carry over, but some practices are specific to non-text inputs. Provider guidance recommends placing images before the question, labeling multiple images so they can be referred to, and sending legible, uncompressed images. Models remain weaker at precise counting, small text, and spatial coordinates, so high-stakes visual answers need checking.

## Example

```
Image 1: [receipt photo]. Image 2: [receipt photo]. List the total on each receipt and say which is larger.
```

## Broader terms

- [Prompt](https://protologue.com/t/prompt/)

## Related terms

- [Context Window](https://protologue.com/t/context-window/)
- [Large Language Model](https://protologue.com/t/large-language-model/)

## Sources

- Yang et al. (2023). The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision). https://arxiv.org/abs/2309.17421
- Anthropic (2024). Vision. https://platform.claude.com/docs/en/build-with-claude/vision

## Cite this entry

Protologue. (2026). Multimodal Prompting. In Protologue: A Taxonomy of Prompting and LLM Techniques (v1.4.0, PTL-0111). https://protologue.com/t/multimodal-prompting/

License: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/)