Dolma

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

Dolma — 3 trillion tokens and a curation toolkit, open-sourced

Why it matters

Released the data together with the tools, making data science reproducible

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2402.00159

Added in Week 35, 2026 · See that week

On the map — ⑫ Training Data line

  1. Previous stopTextbooks Are All You Need
  2. This recordDolma
  3. Next stopGRPO
See it on the map

Same week

KTO — alignment from binary signals based on prospect theoryPaperNomic Embed publishedPaperRAPTOR publishedPaperCorrective RAG publishedPaper

Nearby on the same axis

KTO — alignment from binary signals based on prospect theoryPaperDeepSeek introduces GRPO (DeepSeekMath)PaperRLOOPaperORPOPaper