Evaluation & BenchmarksLianmin Zheng et al. (LMSYS)LMSYS

MT-Bench and LLM-as-a-judge published

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

MT-Bench and LLM-as-a-judge published — a GPT-4 judge agrees with human preferences more than 80% of the time

Why it matters

Became the basis for automated evaluation and synthetic rewards, flowing directly into post-training pipelines

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2306.05685

Added in Week 35, 2026 · See that week

On the map — ⑯ Evaluation line

  1. Previous stopMMLU
  2. This recordMT-Bench and LLM-as-a-judge published
  3. Next stopSWE-bench
See it on the map

Nearby on the same axis

Hugging Face explains the MMLU score mismatch on the Open LLM LeaderboardOfficialLMSYS launches Chatbot ArenaOfficialSWE-bench releasedPaperGPQA releasedPaper