# Chatbot Arena

> Chatbot Arena is a public platform where people chat with two anonymous models side by side and vote for the better response, with the votes aggregated into a leaderboard of model ratings.

- Identifier: PTL-0210
- Category: Benchmarks
- Canonical URL: https://protologue.com/t/chatbot-arena/
- Also known as: LMArena, Arena, LMSYS Chatbot Arena
- Introduced: 2023

## Description

Crowdsourced preferences capture open-ended quality that fixed test sets miss, and new questions from real users resist contamination. Ratings can also reflect style, such as length and formatting, which is why style-controlled rankings are offered. The platform was later renamed, first LMArena and then Arena.

## Broader terms

- [Benchmark](https://protologue.com/t/benchmark/)

## Related terms

- [MT-Bench](https://protologue.com/t/mt-bench/)
- [LLM Judge Bias](https://protologue.com/t/llm-judge-bias/)
- [LLM-as-a-Judge](https://protologue.com/t/llm-as-a-judge/)

## Sources

- Chiang et al. (2024). Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference. https://arxiv.org/abs/2403.04132

## Cite this entry

Protologue. (2026). Chatbot Arena. In Protologue: A Taxonomy of Prompting and LLM Techniques (v1.4.0, PTL-0210). https://protologue.com/t/chatbot-arena/

License: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/)