Google releases the T5 paper and C4
AIMade by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made
Released the T5 paper and C4
Why it matters
The first large-scale standard corpus built by cleaning Common Crawl with heuristics
Source — Primary sources first; secondary reports are labelled “Press”
Paperarxiv.orghttps://arxiv.org/abs/1910.10683Added in Week 35, 2026 · See that week
On the map — ⑫ Training Data line
- Previous stopThe line starts here
- This record · stopT5
- Next stopThe Pile
In the model family tree — Gemini family · 21 versions
- Earlier versionBERT
- This recordT5
- Later versionLaMDA