Lectures

The accompanying material for each lecture is posted here.

Lecture 2: Supervised learning

Supervised learning problem statement, data sets, hypothesis classes, loss functions, basic examples of supervised machine learning models, adding non-linear...

Lecture 3: Neural Networks

Linear and multilayer Perceptron, loss functions, activation functions, pooling, weight sharing, convolutional layers, gradient descent, backpropagation.

Lecture 4: Training Neural Networks

Approximation, estimation and optimization errors, regularization, loss surface curvature, descent-based optimization methods, second-order methods.

Lecture 7: Reinforcement Learning

Markov decision process, policies, rewards, value functions, the Bellman equation, q-learning, policy learning, actor-critic learning.

Additional Resources