Lecture

Recurrent Neural Networks: Neural Language Models

Related lectures (32)

Explores convolutional neural networks, backpropagation, and stochastic gradient descent in deep learning.

Automatic Differentiation: BackProp revisited

Discusses automatic differentiation, emphasizing reverse mode differentiation for optimizing convolutional layer filters by gradient descent.

Neural Networks for NLP

Covers modern Neural Network approaches to NLP, focusing on word embeddings, Neural Networks for NLP tasks, and future Transfer Learning techniques.

Neural Networks: Basics and Applications

Explores neural networks basics, XOR problem, classification, and practical applications like weather data prediction.

Deep Learning: Convolutional Neural Networks and Training Techniques

Discusses convolutional neural networks, their architecture, training techniques, and challenges like adversarial examples in deep learning.

Neural Networks: Regression and Classification

Explores neural networks for regression and classification tasks, covering training, regularization, and practical examples.

Multi-layered Perceptron: History and Training Algorithm

Explores the historical development and training of multi-layered perceptrons, emphasizing the backpropagation algorithm and feature design.

Deep Neural Networks: Optimization and Approximation

Explores optimization and approximation in deep neural networks, including optimal control and numerical experiments.

Convolutional Neural Networks

Covers Convolutional Neural Networks, including layers, training strategies, standard architectures, tasks like semantic segmentation, and deep learning tricks.

Deep Learning for NLP

Introduces deep learning concepts for NLP, covering word embeddings, RNNs, and Transformers, emphasizing self-attention and multi-headed attention.

Neural Networks: Multilayer Perceptrons

Covers Multilayer Perceptrons, artificial neurons, activation functions, matrix notation, flexibility, regularization, regression, and classification tasks.

Regularized Cross-Entropy Risk

Explores the regularized cross-entropy risk in neural networks, covering training processes and challenges in deep networks.