Training Data & Post-TrainingSainz et al.

NLP Evaluation in trouble

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

NLP Evaluation in trouble

Why it matters

A proposal to make measuring contamination for each benchmark a community standard

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2310.18018

Added in Week 35, 2026 · See that week

On the map — ⑫ Training Data line

  1. Previous stopTextbooks Are All You Need
  2. This recordNLP Evaluation in trouble
  3. Next stopGRPO
See it on the map

Same week

FP8-LM publishedPaperBIS issues second round of export controlsGovernment

Nearby on the same axis

Rethinking Benchmark and ContaminationPaperDolmaPaperKTO — alignment from binary signals based on prospect theoryPaperDeepSeek introduces GRPO (DeepSeekMath)Paper