All tutorial materials will be available on this page.

The tutorial notebooks can be obtained by cloning the course tutorials repo, or viewed in your browser by using nbviewer.

Tutorial 5: Optimization

less than 1 minute read

Descent-based methods, backpropagation, automatic differentiation, bi-level optimization, time-series analysis with CNNs.

Tutorial 7: Attention

less than 1 minute read

Attention mechanisms, sequence-to-sequence models, machine translation.

Tutorial 11: CUDA Kernels

less than 1 minute read

The CUDA programming model, numba, implementing CUDA kernels in python, thread synchronization, shared memory