OpenAI publishes the original GPT (GPT-1) paper
AIMade by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made
The GPT (commonly called GPT-1) paper Improving Language Understanding by Generative Pre-Training — a 12-layer decoder-only Transformer pretrained on BooksCorpus, then fine-tuned for each task
Why it matters
Reported that combining unsupervised generative pre-training with supervised fine-tuning improved the state of the art on 9 of the 12 tasks studied
Source — Primary sources first; secondary reports are labelled “Press”
Officialopenai.comhttps://openai.com/index/language-unsupervised/Added in Week 41, 2026 · See that week
On the map — ⑪ Model Architecture line
- Previous stopSparse MoE layer
- This record · stopGPT-1
- Next stopBERT
In the model family tree — GPT family · 23 versions
- Earlier versionThe first version in this branch
- This recordGPT-1
- Later versionGPT-2