한국어EN
Prehistory — From Neural Networks to the TransformerKyunghyun Cho et al. (Université de Montréal)Kyunghyun Cho

Cho et al. publish Learning Phrase Representations using RNN Encoder-Decoder

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

Learning Phrase Representations using RNN Encoder-Decoder released on arXiv — proposed the GRU

Why it matters

Brought the encoder-decoder architecture and the GRU to machine translation, laying the groundwork for attention research

Source — Primary sources first; secondary reports are labelled “Press”

Paperarxiv.orghttps://arxiv.org/abs/1406.1078

Added in Week 35, 2026 · See that week

On the map — ⓪ Prehistory line

  1. Previous stopAlexNet
  2. This recordCho et al. publish Learning Phrase Representations using RNN Encoder-Decoder
  3. Next stopNeural Machine Translation by Jointly Learning to Align and Translate
See it on the map

Nearby on the same axis

Goodfellow et al. publish Generative Adversarial Networks on arXivPaperNeural Machine Translation by Jointly Learning to Align and TranslatePaperVery Deep Convolutional Networks for Large-Scale Image Recognition (VGG)PaperGoogle publishes Sequence to Sequence Learning with Neural Networks on arXivPaper