Ilya Sutskever says results from scaling up pretraining have plateaued
AIMade by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made
Said that results from scaling up pretraining have plateaued
Why it matters
The first public statement of skepticism about pretraining scaling
Source — Primary sources first; secondary reports are labelled “Press”
Pressmalaymail.comhttps://www.malaymail.com/news/money/2024/11/12/openai-and-rivals-seek-new-path-to-smarter-ai-as-current-methods-hit-limitations/156551Added in Week 35, 2026 · See that week
On the map — ⑥ Reasoning Models line
- Previous stopo1-preview
- This recordIlya Sutskever
- Next stopGoogle introduces Gemini 2.0