Lecture

Proximal Operators: Optimization Methods

Related lectures (28)

Introduces regularization techniques to prevent overfitting in machine learning models.

Non-Convex Optimization: Techniques and Applications

Covers non-convex optimization techniques and their applications in machine learning.

Optimization Methods: Convergence and Trade-offs

Covers optimization methods, convergence guarantees, trade-offs, and variance reduction techniques in numerical optimization.

Adversarial Machine Learning: Fundamentals and Techniques

Explores adversarial machine learning, covering the generation of adversarial examples, robustness challenges, and techniques like Fast Gradient Sign Method.

Introduction to Proximal Operators

Introduces proximal operators and conditional gradient methods for composite convex minimization problems in data optimization.

Optimization: Gradient Descent and Subgradients

Explores optimization methods like gradient descent and subgradients for training machine learning models, including advanced techniques like Adam optimization.

Gradient Descent Methods: Theory and Computation

Explores gradient descent methods for smooth convex and non-convex problems, covering iterative strategies, convergence rates, and challenges in optimization.

Linear Models for Classification

Explores linear models for classification, logistic regression, and gradient descent in machine learning.

Regularization Techniques

Explores regularization in linear models, including Ridge Regression and the Lasso, analytical solutions, and polynomial ridge regression.

Gradient Descent Methods

Covers gradient descent methods for convex and nonconvex problems, including smooth unconstrained convex minimization, maximum likelihood estimation, and examples like ridge regression and image classification.

Linear Models for Classification: Logistic Regression and SVM

Covers linear models for classification, focusing on logistic regression and support vector machines.

Machine Learning Fundamentals: Regularization and Cross-validation

Explores overfitting, regularization, and cross-validation in machine learning, emphasizing the importance of feature expansion and kernel methods.

Linear Models and Overfitting

Explores linear models, overfitting, and the importance of feature expansion and adding more data to reduce overfitting.

Linear Models: Recap and Logistic Regression

Covers linear models, binary classification, logistic regression, and model evaluation metrics.

Ridge Regression: Penalised Least Squares

Explores Ridge Regression for handling multicollinearity and the LASSO method for model selection.

Linear Models: Continued

Explores linear models, regression, multi-output prediction, classification, non-linearity, and gradient-based optimization.

Regularization in Machine Learning

Explores Ridge and Lasso Regression for regularization in machine learning models, emphasizing hyperparameter tuning and visualization of parameter coefficients.

Logistic Regression: Cost Functions & Optimization

Explores logistic regression, cost functions, gradient descent, and probability modeling using the logistic sigmoid function.

Linear Regression and Logistic Regression

Covers linear and logistic regression for regression and classification tasks, focusing on loss functions and model training.

Gradient Descent and Linear Regression

Covers stochastic gradient descent, linear regression, regularization, supervised learning, and the iterative nature of gradient descent.