Prehistory — From Neural Networks to the TransformerAlex Graves, Greg Wayne, Ivo Danihelka (DeepMind)Google DeepMind

DeepMind publishes Neural Turing Machines on arXiv

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

Neural Turing Machines released on arXiv — a neural network that reads from and writes to external memory

Why it matters

The idea of handling memory through attention-based addressing. The start of the memory-augmented lineage

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/1410.5401

Added in Week 35, 2026 · See that week

On the map — ⓪ Prehistory line

  1. Previous stopNeural Machine Translation by Jointly Learning to Align and Translate
  2. This recordNeural Turing Machines
  3. Next stopGoogle publishes Distilling the Knowledge in a Neural Network on arXiv
See it on the map

Nearby on the same axis

Google publishes Sequence to Sequence Learning with Neural Networks on arXivPaperVery Deep Convolutional Networks for Large-Scale Image Recognition (VGG)PaperNeural Machine Translation by Jointly Learning to Align and TranslatePaperAdam: A Method for Stochastic OptimizationPaper