Lecture

Gradient-Based Algorithms in High-Dimensional Learning

Related lectures (32)

Socially-aware Artificial Intelligence for Last-mile Mobility

Explores socially-aware AI for last-mile mobility, focusing on understanding social etiquettes, anticipating behaviors, and forecasting crowd movements.

Perception: Data-Driven Approaches

Explores perception in deep learning for autonomous vehicles, covering image classification, optimization methods, and the role of representation in machine learning.

Gradient Descent on Two-Layer ReLU Neural Networks

Analyzes gradient descent on two-layer ReLU neural networks, exploring global convergence, regularization, implicit bias, and statistical efficiency.

Deep Learning: Overparameterization and Generalization

Explores overparameterization, generalization, overfitting, underfitting, and implicit regularization in deep learning models.

Statistical Learning: Fundamentals

Introduces the fundamentals of statistical learning, covering supervised learning, decision theory, risk minimization, and overfitting.

AI for Science

Explores fundamental principles in scientific research, the impact of computers, numerical algorithms, and deep learning in solving high-dimensional problems.

Neural Networks: Training and Optimization

Explores neural network training, optimization, and environmental considerations, with insights into PCA and K-means clustering.

Deep Neural Networks: Training and Optimization

Explores deep neural network training, optimization, preventing overfitting, and different network architectures.

Learning with Deep Neural Networks

Explores the success and challenges of deep learning, including overfitting, generalization, and the impact on various domains.

Deep Learning: Designing Neural Network Models

Covers the design and optimization of neural network models in deep learning.

Deep Learning

Covers the fundamentals of deep learning, including data representations, bag of words, data pre-processing, artificial neural networks, and convolutional neural networks.

Deep Learning: Multilayer Perceptron and Training

Covers deep learning fundamentals, focusing on multilayer perceptrons and their training processes.

Recurrent Neural Networks: Language Detection

Explores language detection using Recurrent Neural Networks and supervised learning concepts.

Understanding Deep Learning

Explores deep learning fundamentals, including image classification, neural network working principles, and machine learning challenges.

Nonlinear Supervised Learning

Explores the inductive bias of different nonlinear supervised learning methods and the challenges of hyper-parameter tuning.

Financial Time Series Analysis

Covers stylized facts of asset returns, summary statistics, testing for normality, Q-Q plots, and efficient market hypothesis.

Deep Splines: Unifying Framework for Deep Neural Networks

Introduces a functional framework for deep neural networks with adaptive piecewise-linear splines, focusing on biomedical image reconstruction and the challenges of deep splines.

Deep Learning Fundamentals

Introduces deep learning fundamentals, covering data representations, neural networks, and convolutional neural networks.

Reinforcement Learning Concepts

Covers key concepts in reinforcement learning, neural networks, clustering, and unsupervised learning, emphasizing their applications and challenges.

Neural Network Approximation and Learning

Delves into neural network approximation, supervised learning, challenges in high-dimensional learning, and deep learning experimental revolution.