Tutorials

Zoom link for tutorials

All tutorial materials will be available on this page.

The tutorial notebooks can be obtained by cloning the course tutorials repo, or viewed in your browser by using nbviewer.

Tutorial 5: Optimization

less than 1 minute read

Descent-based methods, backpropagation, automatic differentiation, bi-level optimization, time-series analysis with CNNs.

Tutorial 8: RNN

less than 1 minute read

RNN, BPTT and TBTT, LSTM and GRU, sentiment analisys and stock prediction.

Tutorial 9: Attention

less than 1 minute read

The attention mechanisem. soft and hard, multiplicative and additive, scaled dot product, attention for alignment translation