Rectified Linear Units Improve Restricted Boltzmann Machines

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

Rectified Linear Units Improve Restricted Boltzmann Machines — presented at ICML 2010

Why it matters

An early paper demonstrating the advantages of ReLU, which later became the standard activation function

Source — Primary sources first; secondary reports are labelled “Press”

Papercs.toronto.eduhttps://www.cs.toronto.edu/~hinton/absps/reluICML.pdf

Added in Week 35, 2026 · See that week

On the map — ⓪ Prehistory line

  1. Previous stopImageNet
  2. This recordRectified Linear Units Improve Restricted Boltzmann Machines
  3. Next stopAlexNet
See it on the map

Nearby on the same axis

Bergstra et al. present TheanoOfficialUnderstanding the difficulty of training deep feedforward neural networksPaperImageNet holds the first ILSVRCOfficialDeep Big Simple Neural Nets Excel on Handwritten Digit RecognitionPaper