Lecture

Long Short-Term Memory Networks

Related lectures (32)

Explores neural networks optimization, including backpropagation, batch normalization, weight initialization, and hyperparameter search strategies.

Non-Conceptual Knowledge Systems

Delves into the impact of deep learning on non-conceptual knowledge systems and the advancements in transformers and generative adversarial networks.

Neural Network Approximation and Learning

Delves into neural network approximation, supervised learning, challenges in high-dimensional learning, and deep learning experimental revolution.

Deep Learning for NLP

Introduces deep learning concepts for NLP, covering word embeddings, RNNs, and Transformers, emphasizing self-attention and multi-headed attention.

Deep Learning: Data Representations and Neural Networks

Covers data representations, Bag of Words, histograms, data pre-processing, and neural networks.

Deep Learning: Recurrent Neural Networks

Explores Recurrent Neural Networks for behavioral data, covering Deep Knowledge Tracing, LSTM, GRU networks, hyperparameter tuning, and time series prediction tasks.

Splines and Imaging: From Compressed Sensing to Deep Neural Nets

Explores the optimality of splines for imaging and deep neural networks, demonstrating sparsity and global optimality with spline activations.

Recurrent Neural Networks: Neural Language Models

Explores fixed-context neural language models, RNNs, vanishing gradients, and sequence labeling in NLP.

Deep Learning for NLP

Delves into Deep Learning for Natural Language Processing, exploring Neural Word Embeddings, Recurrent Neural Networks, and Attentive Neural Modeling with Transformers.

Deep Learning: Data Representations and Neural Networks

Explores data representations, histograms, neural networks, and deep learning concepts.

Neural Networks: Multilayer Learning

Covers the fundamentals of multilayer neural networks and deep learning, including back-propagation and network architectures like LeNet, AlexNet, and VGG-16.

Deep Neural Networks: Training and Optimization

Explores deep neural network training, optimization, preventing overfitting, and different network architectures.