Lecture 4: Training Neural Networks

Approximation, estimation and optimization errors, regularization, loss surface curvature, descent-based optimization methods, second-order methods.