Prehistory — From Neural Networks to the TransformerRajat Raina, Anand Madhavan, Andrew Y. Ng (Stanford University)Andrew NgStanford University

Large-scale Deep Unsupervised Learning using Graphics Processors

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

Large-scale Deep Unsupervised Learning using Graphics Processors — presented at ICML 2009

Why it matters

An early case of applying GPUs to deep learning training in earnest. The starting point of the premise that compute is a resource

Source — Primary sources first; secondary reports are labelled “Press”

Paperrobotics.stanford.eduhttp://robotics.stanford.edu/~ang/papers/icml09-LargeScaleUnsupervisedDeepLearningGPU.pdf

Added in Week 35, 2026 · See that week

On the map — ⓪ Prehistory line

  1. Previous stopImageNet
  2. This recordLarge-scale Deep Unsupervised Learning using Graphics Processors
  3. Next stopAlexNet
See it on the map

Nearby on the same axis

ImageNet: A Large-Scale Hierarchical Image DatabaseOfficialDeep Big Simple Neural Nets Excel on Handwritten Digit RecognitionPaperUnderstanding the difficulty of training deep feedforward neural networksPaperImageNet holds the first ILSVRCOfficial