AI Infrastructure SoftwareAlexander Sergeev et al. (Uber)
Uber presents Horovod
AIMade by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made
Presented Horovod — ring all-reduce cut communication overhead between GPUs and reduced the changes needed in user code to a few lines
Why it matters
The turning point that brought distributed training down from research infrastructure to an everyday tool
Source — Primary sources first; secondary reports are labelled “Press”
Paperarxiv.orghttps://arxiv.org/abs/1802.05799Added in Week 35, 2026 · See that week
On the map — ⑱ AI Infrastructure Software line
- Previous stopXLA
- This recordHorovod
- Next stopMegatron-LM