한국어EN
Prehistory — From Neural Networks to the TransformerYoshua Bengio et al.Yoshua Bengio

A Neural Probabilistic Language Model

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

A Neural Probabilistic Language Model — JMLR 3, 1137–1155

Why it matters

Proposed a neural language model that learns words as dense vectors. The direct predecessor of the embedding lineage that includes word2vec

Source — Primary sources first; secondary reports are labelled “Press”

Paperjmlr.orghttps://www.jmlr.org/papers/v3/bengio03a.html

Added in Week 35, 2026 · See that week

On the map — ⓪ Prehistory line

  1. Previous stopGradient-based learning applied to document recognition
  2. This record · stopNeural language model
  3. Next stopImageNet
See it on the map

Nearby on the same axis

A Fast Learning Algorithm for Deep Belief NetsPaperGreedy Layer-Wise Training of Deep NetworksPaperGradient-based learning applied to document recognitionPressHochreiter and Schmidhuber publish Long Short-Term MemoryOfficial