Model Architecture & Training MethodsRumbelow & Watkins
SolidGoldMagikarp
AIMade by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made
SolidGoldMagikarp — found 141 glitch tokens
Why it matters
Popularized the idea that a mismatch between the tokenizer and the model's training corpus is a real failure mode
Source — Primary sources first; secondary reports are labelled “Press”
Officiallesswrong.comhttps://www.lesswrong.com/posts/aPeJE8bSo6rAFoLqg/solidgoldmagikarp-plus-prompt-generationAdded in Week 35, 2026 · See that week
On the map — ⑪ Model Architecture line
- Previous stopChinchilla
- This record · stopSolidGoldMagikarp
- Next stopStreamingLLM