Prompt EngineeringOpenAI (Kaplan et al.)OpenAI

Scaling Laws for Neural Language Models

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

Scaling Laws for Neural Language Models

Why it matters

Showed that loss can be predicted as a power law of model size, data and compute, becoming the rationale for large-scale investment

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2001.08361

Added in Week 35, 2026 · See that week

On the map — ① Prompt Engineering line

  1. Previous stopGPT-2
  2. This recordScaling Laws for Neural Language Models
  3. Next stopGPT-3
See it on the map

Nearby on the same axis

OpenAI publishes the GPT-3 (175B) paper Language Models are Few-Shot LearnersPaperOpenAI releases the OpenAI API in beta (text in, text out)OfficialOpenAI announces GPT-2 (1.5B), withholds full model over misuse concernsOfficialFLANPaper