Lecture

Second-Order Model Compression

Related lectures (32)

Deep Learning: Convolutional Neural Networks

Introduces Convolutional Neural Networks, explaining their architecture, training process, and applications in semantic segmentation tasks.

Deep Neural Networks: Optimization and Approximation

Explores optimization and approximation in deep neural networks, including optimal control and numerical experiments.

Deep Neural Networks: Training and Optimization

Explores deep neural network training, optimization, preventing overfitting, and different network architectures.

Scaling Language Models: Efficiency and Deployment

Covers the scaling of language models, focusing on training efficiency and deployment considerations.

Deep Learning Fundamentals

Introduces deep learning, from logistic regression to neural networks, emphasizing the need for handling non-linearly separable data.

Deep Learning

Covers the fundamentals of deep learning, including data representations, bag of words, data pre-processing, artificial neural networks, and convolutional neural networks.

Non-Conceptual Knowledge Systems

Delves into the impact of deep learning on non-conceptual knowledge systems and the advancements in transformers and generative adversarial networks.

Deep Learning: Convolutional Neural Networks and Training Techniques

Discusses convolutional neural networks, their architecture, training techniques, and challenges like adversarial examples in deep learning.

Learning from the Interconnected World with Graphs

Explores learning from interconnected data using graphs, covering challenges, GNN design, research landscapes, and democratization of Graph ML.

Nonlinear Supervised Learning

Explores the inductive bias of different nonlinear supervised learning methods and the challenges of hyper-parameter tuning.

Convolutional Neural Networks: Fundamentals

Covers the basics of Convolutional Neural Networks, including training optimization, layer structure, and potential pitfalls of summary statistics.

Neural Networks: Perceptron and Backpropagation

Covers the basics of neural networks, including the perceptron model and backpropagation.