Lecture

Support Vector Regression: Recap and Convex Optimization

Related lectures (31)

Linear Regression and Logistic Regression

Covers linear and logistic regression for regression and classification tasks, focusing on loss functions and model training.

Convex Optimization: Examples of Convex Functions

Explores convex optimization, convex functions, and their properties, including strict convexity and strong convexity, as well as different types of convex functions like linear affine functions and norms.

Nonparametric Regression: Kernel-Based Estimation

Covers nonparametric regression using kernel-based estimation techniques to model complex relationships between variables.

Probabilistic Models for Linear Regression

Covers the probabilistic model for linear regression and its applications in nuclear magnetic resonance and X-ray imaging.

Support Vector Regression: Principles and Optimization

Covers Support Vector Regression principles, optimization, and hyperparameters' influence on the fit.

Linear Models for Classification

Covers linear models for classification, including SVM, decision boundaries, support vectors, and Lagrange duality.

Linear Models: Continued

Explores linear models, regression, multi-output prediction, classification, non-linearity, and gradient-based optimization.

Weak and Strong Duality

Covers weak and strong duality in optimization problems, focusing on Lagrange multipliers and KKT conditions.

Linear and Weighted Regression: Optimal Parameters and Local Solutions

Covers linear and weighted regression, optimal parameters, local solutions, SVR application, and regression techniques' sensitivity.

Linear Programming Duality

Explores Linear Programming Duality, covering weak duality, strong duality, Lagrange multipliers interpretation, and optimization constraints.

Quantile Regression: Linear Optimization

Covers quantile regression, focusing on linear optimization for predicting outputs and discussing sensitivity to outliers, problem formulation, and practical implementation.

Convex Optimization: Nonlinear Dimensionality Reduction

Explores convex optimization in nonlinear dimensionality reduction, showcasing practical applications in signal processing and regression tasks.

Linear Models for Classification: Logistic Regression and SVM

Covers linear models for classification, focusing on logistic regression and support vector machines.

KKT and Convex Optimization

Covers the KKT conditions and convex optimization, discussing constraint qualifications and tangent cones of convex sets.

Convex Optimization: Duality and KKT Conditions

Explores convex optimization duality, KKT conditions, and financial arbitrage detection.

Support Vector Regression: Kernel Tricks

Explores Ridge and SVR regression, emphasizing kernel tricks for non-linear regression.

Introduction to Proximal Operators

Introduces proximal operators and conditional gradient methods for composite convex minimization problems in data optimization.

Regression: Interactive Lecture

Covers linear regression, weighted regression, locally weighted regression, support vector regression, noise handling, and eye mapping using SVR.

Lagrangian Duality: Theory and Applications

Explores Lagrangian duality in convex optimization, discussing strong duality, dual solutions, and practical applications in second-order cone programs.

Convex Optimization: Gradient Algorithms

Covers convex optimization problems and gradient-based algorithms to find the global minimum.