Lecture

Introduction to Supervised Learning: Classification and Perceptrons

Related lectures (30)

Introduces the basics of machine learning, covering supervised classification, logistic regression, and maximizing the margin.

Neural Networks: Regression and Classification

Explores neural networks for regression and classification tasks, covering training, regularization, and practical examples.

Statistical Learning: Fundamentals

Introduces the fundamentals of statistical learning, covering supervised learning, decision theory, risk minimization, and overfitting.

Neural Networks: Multilayer Perceptrons

Covers Multilayer Perceptrons, artificial neurons, activation functions, matrix notation, flexibility, regularization, regression, and classification tasks.

Introduction to Machine Learning: Supervised Learning

Introduces supervised learning, covering classification, regression, model optimization, overfitting, and kernel methods.

Nonlinear Supervised Learning

Explores the inductive bias of different nonlinear supervised learning methods and the challenges of hyper-parameter tuning.

Supervised Learning: Classification and Regression

Covers supervised learning, classification, regression, decision boundaries, overfitting, Perceptron, SVM, and logistic regression.

Neural Networks Recap: Activation Functions

Covers the basics of neural networks, activation functions, training, image processing, CNNs, regularization, and dimensionality reduction methods.

Introduction to Learning by Stochastic Gradient Descent: Simple Perceptron

Covers the derivation of the stochastic gradient descent formula for a simple perceptron and explores the geometric interpretation of classification.

Dimensionality Reduction: PCA and Autoencoders

Introduces artificial neural networks, CNNs, and dimensionality reduction using PCA and autoencoders.

Unsupervised Learning: Dimensionality Reduction

Explores unsupervised learning techniques for reducing dimensions in data, emphasizing PCA, LDA, and Kernel PCA.

Kernel Methods: Neural Networks

Covers the fundamentals of neural networks, focusing on RBF kernels and SVM.

Neural Networks: Basics and Applications

Explores neural networks basics, XOR problem, classification, and practical applications like weather data prediction.

Neural Networks: Perceptron Model and Backpropagation Algorithm

Covers the perceptron model and backpropagation algorithm in neural networks.

Multilayer Networks: First Steps

Covers the preparation for deriving the Backprop algorithm in layered networks using multi-layer perceptrons and gradient descent.

Supervised Learning Overview

Covers CNNs, RNNs, SVMs, and supervised learning methods, emphasizing the importance of tuning regularization and making informed decisions in machine learning.

Pytorch Intro: MNIST and Digits

Covers Pytorch basics with MNIST and Digits datasets, focusing on training neural networks for handwritten digit recognition.

Neural Network Approximation and Learning

Delves into neural network approximation, supervised learning, challenges in high-dimensional learning, and deep learning experimental revolution.

Statistical Physics of Learning

Offers insights into the statistical physics of learning, exploring the relationship between neural network structure and disordered systems.

Introduction to Machine Learning

Provides an overview of Machine Learning, including historical context, key tasks, and real-world applications.