Lecture 4: Training Neural Networks

Approximation, estimation and optimization errors, regularization, loss surface curvature, descent-based optimization methods, second-order methods.

Videos

  • Introductory lecture
  • Main Lecture

Slides

Supplementary Slides