Concept

Residual neural network

Related lectures (29)

Explores convolutional neural networks, backpropagation, and stochastic gradient descent in deep learning.

Deep and Convolutional Networks: Generalization and Optimization

Explores deep and convolutional networks, covering generalization, optimization, and practical applications in machine learning.

Multi-layered Perceptron: History and Training Algorithm

Explores the historical development and training of multi-layered perceptrons, emphasizing the backpropagation algorithm and feature design.

Transformers in Vision

Explores the evolution of visual intelligence models, focusing on Transformers and their applications in computer vision and natural language processing.

NFNets: Removing BatchNorm for High-Performance Image Recognition

Explores NFNets as an alternative to BatchNorm in ResNets, achieving high performance on ImageNet.

Deep Learning: Convolutional Neural Networks

Covers Convolutional Neural Networks, standard architectures, training techniques, and adversarial examples in deep learning.

Pavement Distress Detection

Covers the importance of preventive maintenance for pavement distress detection and introduces machine learning concepts for engineers.

Convolutional Neural Networks

Covers Convolutional Neural Networks, including layers, training strategies, standard architectures, tasks like semantic segmentation, and deep learning tricks.

Convolutional Neural Networks: Structure & Regularization

Explores Convolutional Neural Networks, data augmentation, weight decay, and dropout for enhancing model performance.

Convolutional Networks: Overview and Architecture

Covers the motivation and architecture of convolutional networks, from LeNet to AlexNet.

Deep Learning: Convolutional Neural Networks

Introduces Convolutional Neural Networks, explaining their architecture, training process, and applications in semantic segmentation tasks.

Neural Networks for NLP

Covers modern Neural Network approaches to NLP, focusing on word embeddings, Neural Networks for NLP tasks, and future Transfer Learning techniques.

Deep Learning Fundamentals

Introduces the fundamentals of deep learning, covering neural networks, CNNs, special layers, weight initialization, data preprocessing, and regularization.

Convolutional Neural Networks

Explores Convolutional Neural Networks, focusing on layers, filters, pooling, and weight sharing.

Long Short-Term Memory Networks

Introduces Long Short-Term Memory (LSTM) networks as a solution to vanishing and exploding gradients in recurrent neural networks.

Deep Learning Fundamentals

Introduces deep learning, from logistic regression to neural networks, emphasizing the need for handling non-linearly separable data.

Nonlinear Supervised Learning

Explores the inductive bias of different nonlinear supervised learning methods and the challenges of hyper-parameter tuning.

Convolutional Neural Networks: Fundamentals

Covers the basics of Convolutional Neural Networks, including training optimization, layer structure, and potential pitfalls of summary statistics.

Building Physical Neural Networks

Discusses challenges in building physical neural networks, focusing on depth, connections, and trainability.

Sequence to Sequence Models: Overview and Applications

Covers sequence to sequence models, their architecture, applications, and the role of attention mechanisms in improving performance.