Training Data & Post-TrainingTogether
RedPajama-Data-1T
AIMade by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made
RedPajama-Data-1T
Why it matters
An open reproduction of the LLaMA training recipe that opened an era of reverse-engineering the data behind closed models
Source — Primary sources first; secondary reports are labelled “Press”
Officialtogether.aihttps://www.together.ai/blog/redpajamaAdded in Week 35, 2026 · See that week
On the map — ⑫ Training Data line
- Previous stopSelf-Instruct
- This recordRedPajama-Data-1T
- Next stopTextbooks Are All You Need