Google Research announces PaLM (540B)

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

PaLM (Pathways Language Model) announced — a 540B dense decoder-only Transformer trained on 6,144 TPU v4 chips with Pathways

Why it matters

The first large-scale use of the Pathways system; reported surpassing the few-shot performance of prior large models such as GPT-3, Gopher and Chinchilla on 28 of 29 English NLP tasks

Source — Primary sources first; secondary reports are labelled “Press”

Officialresearch.googlehttps://research.google/blog/pathways-language-model-palm-scaling-to-540-billion-parameters-for-breakthrough-performance/

Added in Week 41, 2026 · See that week

On the map — ⑪ Model Architecture line

  1. Previous stopChinchilla
  2. This recordPaLM
  3. Next stopSolidGoldMagikarp
See it on the map

In the model family tree — Gemini family · 21 versions

  1. Earlier versionLaMDA
  2. This recordPaLM
  3. Later versionBard
See the whole Gemini family

Nearby on the same axis

ChinchillaPaperModel SoupsPapermuP / Tensor Programs VPaperEmergent Abilities of LLMsPaper