Lecture

Optimal Errors and Phase Transitions

Related lectures (31)

Neural Networks: Training and Optimization

Explores neural network training, optimization, and environmental considerations, with insights into PCA and K-means clustering.

Statistical Learning: Fundamentals

Introduces the fundamentals of statistical learning, covering supervised learning, decision theory, risk minimization, and overfitting.

Neural Network Approximation and Learning

Delves into neural network approximation, supervised learning, challenges in high-dimensional learning, and deep learning experimental revolution.

Brain Intelligence: Continual Learning of Representational Models

Delves into the continual learning of representational models after deployment, highlighting the limitations of current artificial neural networks.

Introduction to Machine Learning: Supervised Learning

Introduces supervised learning, covering classification, regression, model optimization, overfitting, and kernel methods.

Supervised Learning Overview

Covers CNNs, RNNs, SVMs, and supervised learning methods, emphasizing the importance of tuning regularization and making informed decisions in machine learning.

Deep Learning: Dimensionality and Data Representation

Delves into deep learning's dimensionality, data representation, and performance in classifying large-dimensional data, exploring the curse of dimensionality and the neural tangent kernel.

Unsupervised Learning: Clustering & Dimensionality Reduction

Introduces unsupervised learning through clustering with K-means and dimensionality reduction using PCA, along with practical examples.

Dimensionality Reduction: PCA and Autoencoders

Introduces artificial neural networks, CNNs, and dimensionality reduction using PCA and autoencoders.

Unsupervised Learning: Dimensionality Reduction

Explores unsupervised learning techniques for reducing dimensions in data, emphasizing PCA, LDA, and Kernel PCA.

Nonlinear Supervised Learning

Explores the inductive bias of different nonlinear supervised learning methods and the challenges of hyper-parameter tuning.

Financial Time Series Analysis

Covers stylized facts of asset returns, summary statistics, testing for normality, Q-Q plots, and efficient market hypothesis.

Introduction to Machine Learning

Provides an overview of Machine Learning, including historical context, key tasks, and real-world applications.

Machine Learning Fundamentals

Covers key concepts and examples of machine learning algorithms and techniques.

Introduction to Image Classification

Covers image classification, clustering, and machine learning techniques like dimensionality reduction and reinforcement learning.

Deep Splines: Unifying Framework for Deep Neural Networks

Introduces a functional framework for deep neural networks with adaptive piecewise-linear splines, focusing on biomedical image reconstruction and the challenges of deep splines.

Neural Networks Recap: Activation Functions

Covers the basics of neural networks, activation functions, training, image processing, CNNs, regularization, and dimensionality reduction methods.

Perception: Data-Driven Approaches

Explores perception in deep learning for autonomous vehicles, covering image classification, optimization methods, and the role of representation in machine learning.

Improving Models of the Ventral Visual Pathway

Explores computational models of the ventral visual system, focusing on optimizing networks for real-world tasks and comparing to brain data.

Splines and Machine Learning

Explores supervised learning as an ill-posed problem and the integration of sparse adaptive splines into neural architectures.