Tutorials

All tutorial materials will be available on this page.

The tutorial notebooks can be obtained by cloning the course tutorials repo, or viewed in your browser by using nbviewer.

Tutorial 5: Optimization

less than 1 minute read

Descent-based methods, backpropagation, automatic differentiation, bi-level optimization, time-series analysis with CNNs.

Tutorial 7: Attention

less than 1 minute read

Attention mechanisms, sequence-to-sequence models, machine translation.

Tutorial 11: CUDA Kernels

less than 1 minute read

The CUDA programming model, numba, implementing CUDA kernels in python, thread synchronization, shared memory