Backpropagation

Also known as Backprop, Reverse-mode training. This is the canonical page; those names redirect here.

Pairings in the atlas

Stochastic gradient descentcanonNeural network training machine-learning
Adam optimizercanonNeural network training machine-learning
MomentumcanonNeural network training machine-learning
RMSPropstandardNeural network training machine-learning
AdaGradstandardSparse-gradient training machine-learning
AdamW decoupled decaystandardNeural network training machine-learning

Rivals: other methods for the same problems

Backpropagation through time

Where it sits

machine-learning · Machine Learning & AI