Concept

Backpropagation

Related lectures (29)

Covers the backpropagation algorithm for training neural networks and the representation of functions in multilayer networks.

Neural Networks: Training and Activation

Explores neural networks, activation functions, backpropagation, and PyTorch implementation.

Neural Networks: Multilayer Learning

Covers the fundamentals of multilayer neural networks and deep learning, including back-propagation and network architectures like LeNet, AlexNet, and VGG-16.

Multilayer Perceptron: Training and Optimization

Explores the multilayer perceptron model, training, optimization, data preprocessing, activation functions, backpropagation, and regularization.

Feed-forward Networks

Introduces feed-forward networks, covering neural network structure, training, activation functions, and optimization, with applications in forecasting and finance.

Deep Learning: Data Representation and Multilayer Perceptron

Covers data representation, MLP training, activation functions, and gradient-based learning in deep neural networks.

Feedforward Neural Networks: Activation Functions and Backpropagation

Introduces feedforward neural networks, activation functions, and backpropagation for training, addressing challenges and powerful methods.

Neural Networks Optimization

Explores neural networks optimization, including backpropagation, batch normalization, weight initialization, and hyperparameter search strategies.

Multilayer Perceptron: Training and Backpropagation

Explores the challenges of training Multilayer Perceptrons and the backpropagation algorithm.

MLPs: Multi-Layer Perceptrons

Introduces Multi-Layer Perceptrons (MLPs) and covers logistic regression, reformulation, gradient descent, AdaBoost, and practical applications.

Recurrent Neural Networks: Neural Language Models

Explores fixed-context neural language models, RNNs, vanishing gradients, and sequence labeling in NLP.

Deep Learning: Convolutional Networks

Explores convolutional neural networks, backpropagation, and stochastic gradient descent in deep learning.

Bio-Inspired Learning: Neural Networks, Genetic Algorithms

Explores bio-inspired learning with neural networks and genetic algorithms, covering structure, training, and practical applications.

Neural Networks: Multi-layers

Explains the learning process in multi-layer neural networks, including back-propagation, activation functions, weights update, and error backpropagation.

Building Physical Neural Networks

Discusses challenges in building physical neural networks, focusing on depth, connections, and trainability.

Deep Learning Building Blocks

Covers tensors, loss functions, autograd, and convolutional layers in deep learning.

Deep Learning: Multilayer Perceptron and Training

Covers deep learning fundamentals, focusing on multilayer perceptrons and their training processes.

Neural Networks: Supervised Learning and Backpropagation

Explains neural networks, supervised learning, and backpropagation for training and improving performance.

Automatic Differentiation: BackProp revisited

Discusses automatic differentiation, emphasizing reverse mode differentiation for optimizing convolutional layer filters by gradient descent.

Multilayer Networks: First Steps

Covers the preparation for deriving the Backprop algorithm in layered networks using multi-layer perceptrons and gradient descent.