Lecture 4: Training and Optimization Approximation, estimation and optimization errors, regularization, loss surface curvature, descent-based optimization methods, second-order methods. Videos Introductory lecture Main Lecture Slides Supplementary Slides Previous Next