Lecture 5: Sequence Models

RNN model, input-output sequences relationships, non-sequential input, layered RNN, backpropagation through time, word embeddings, attention, transformers.

Video

Supplementary Video

Word embeddings

Slides

Supplementary Slides

Lecture Notes

Accompanying notes for this lecture can be found here.