Model Architecture & Training MethodsPearce & Song
Reconciling Kaplan and Chinchilla Scaling Laws
AIMade by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made
Reconciling Kaplan and Chinchilla Scaling Laws
Why it matters
Showed that the conflict between the two laws stems from counting non-embedding parameters and from analysis at small scale
Source — Primary sources first; secondary reports are labelled “Press”
Paperarxiv.orghttps://arxiv.org/abs/2406.12907Added in Week 35, 2026 · See that week
On the map — ⑪ Model Architecture line
- Previous stopDeepSeek-V2
- This recordReconciling Kaplan and Chinchilla Scaling Laws
- Next stopByte Latent Transformer