Understanding the difficulty of training deep feedforward neural networks

Made by AIWritten by AI (Claude) from the source below. Check anything important against the source.How it's made

Understanding the difficulty of training deep feedforward neural networks — presented at AISTATS 2010

Why it matters

Showed that activation functions and initialization determine training stability. The origin of Glorot initialization

Source — Primary sources first; secondary reports are labelled “Press”

Paperproceedings.mlr.presshttp://proceedings.mlr.press/v9/glorot10a.html

Added in Week 35, 2026 · See that week

On the map — ⓪ Prehistory line

  1. Previous stopImageNet
  2. This recordUnderstanding the difficulty of training deep feedforward neural networks
  3. Next stopAlexNet
See it on the map

Nearby on the same axis

ImageNet holds the first ILSVRCOfficialRectified Linear Units Improve Restricted Boltzmann MachinesPaperBergstra et al. present TheanoOfficialDeep Big Simple Neural Nets Excel on Handwritten Digit RecognitionPaper