Prehistory — From Neural Networks to the TransformerKaiming He et al. (Microsoft Research Asia)Microsoft Research
He et al. publish Deep Residual Learning for Image Recognition (ResNet) on arXiv
AIMade by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made
Deep Residual Learning for Image Recognition (ResNet) released on arXiv
Why it matters
Made training of very deep networks possible through residual connections. A basic component of most later architectures, including the Transformer
Source — Primary sources first; secondary reports are labelled “Press”
Paperarxiv.orghttps://arxiv.org/abs/1512.03385Added in Week 35, 2026 · See that week
On the map — ⓪ Prehistory line
- Previous stopGoogle publishes Distilling the Knowledge in a Neural Network on arXiv
- This recordHe et al. publish Deep Residual Learning for Image Recognition (ResNet) on arXiv
- Next stopAlphaGo–Lee Sedol five-game match in Seoul ends (Mar 9–15)