Part 3: Gradient Descent << First < Prev Neural Networks Demystified Next > Last >> More by StephenWelch: Part 4: Backpropagation Imaginary Numbers are Real - Part 1: Introduction Part 7: Overfitting, Testing, and Regularization Part 5: Numerical Gradient Checking
Wonderful introduction to the terminology of stochastic gradient descent. I am just in awe of the didactic prowess displayed. It took me days to synthesize the same information reading Goodfellow's DL book. Well done.