Using automatic differentiation for reverse-mode AD in neural networks (backpropagation).

Implementing automatic differentiation using operator overloading and forward/reverse modes.

Introduction to recurrent neural networks and applying them to POS tagging.

Improving neural network performance with ReLU, softmax, and mini-batch gradient descent.

Word embeddings and vector representations: one-hot vectors, co-occurrence matrices, and SVD.