AI Infrastructure SoftwareLianmin Zheng et al. (UC Berkeley)UC Berkeley

Zheng et al. present Alpa

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

Presented Alpa — automated inter-operator and intra-operator parallelism

Why it matters

Automated the search for parallelization strategies. Redefined manual 3D parallelism tuning as a compilation problem

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/2201.12023

Added in Week 35, 2026 · See that week

On the map — ⑱ AI Infrastructure Software line

  1. Previous stopZeRO-Offload
  2. This recordAlpa
  3. Next stopHopper H100
See it on the map

Same week

Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsPaperOpenAI announces InstructGPT and makes it the API's default modelOfficial

Nearby on the same axis

NVIDIA unveils the Hopper H100OfficialGoogle presents PathwaysPaperPyTorch opens the FSDP2 RFCOfficialDao et al. present FlashAttentionPaper