Lecture 4: Training Neural Networks

Approximation, estimation and optimization errors, regularization, loss surface curvature, descent-based optimization methods, second-order methods.

Slides

  • Part A
  • Part B

Videos

  • Introductory lecture
  • Part A
  • Part B

Updated: