DeepSeek introduces GRPO (DeepSeekMath)

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

GRPO introduced (DeepSeekMath)

Why it matters

Group relative policy optimization without a value function later became the de facto standard for RL in reasoning models

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2402.03300

Added in Week 35, 2026 · See that week

On the map — ⑫ Training Data line

  1. Previous stopTextbooks Are All You Need
  2. This record · stopGRPO
  3. Next stopRunning out of data?
See it on the map

In the model family tree — DeepSeek family · 12 versions

  1. Earlier versionThe first version in this branch
  2. This recordDeepSeekMath
  3. Later versionDeepSeek-Coder-V2
See the whole DeepSeek family

Same week

The Unreasonable Effectiveness of Eccentric Automatic Prompts publishedPaperDebating with More Persuasive LLMs (ICML 2024 Best Paper)PaperSelf-Discover publishedPaper

Nearby on the same axis

KTO — alignment from binary signals based on prospect theoryPaperDolmaPaperRLOOPaperORPOPaper