Lecture

LASSO Regression: Sparse Signal Induction

Related lectures (30)

Linear Regression: Statistical Inference and Regularization

Covers the probabilistic model for linear regression and the importance of regularization techniques.

Covers the concept of sparse regression and the use of Gaussian additive noise in the context of MAP estimator and regularization.

Probabilistic Models for Linear Regression

Covers the probabilistic model for linear regression and its applications in nuclear magnetic resonance and X-ray imaging.

Regularization in Machine Learning

Explores Ridge and Lasso Regression for regularization in machine learning models, emphasizing hyperparameter tuning and visualization of parameter coefficients.

Model Selection: Least Squares

Explores model selection in least squares regression, addressing multicollinearity challenges and introducing shrinkage techniques.

Comparing L1 and L0 + Greedy algorithms

Compares L1 and L0 penalization in linear regression with orthogonal designs using greedy algorithms and empirical comparisons.

From Stochastic Gradient Descent to Non-Smooth Optimization

Covers stochastic optimization, sparsity, and non-smooth minimization via subgradient descent.

Geometry of the Lasso

Explores the geometric explanation of why Lasso solutions are sparse and how coefficients change with the regularization parameter.

Polynomial Regression and Gradient Descent

Covers polynomial regression, gradient descent, overfitting, underfitting, regularization, and feature scaling in optimization algorithms.

Model Building: Linear Regression

Explores model building in linear regression, covering techniques like stepwise regression and ridge regression to address multicollinearity.

Regression Methods: Model Building and Inference

Covers analysis of variance, model building, variable selection, and function estimation in regression methods.

Untitled

Overfitting in Supervised Learning: Case Studies and Techniques

Addresses overfitting in supervised learning through polynomial regression case studies and model selection techniques.

Generalized Linear Regression

Explores generalized linear regression, logistic regression, and multiclass classification in machine learning.

Functional Linear Regression: Sparse Estimation and Adaptive Methods

By Angelina Roche covers adaptive and sparse estimation in functional linear regression models.

Concise Signal Models and Compressive Sensing

Explores concise signal models, compressive sensing, sparsity, atomic norms, and non-smooth minimization using subgradient descent.

Supervised Learning: Regression Methods

Explores supervised learning with a focus on regression methods, including model fitting, regularization, model selection, and performance evaluation.

Machine Learning Fundamentals: Regularization and Cross-validation

Explores overfitting, regularization, and cross-validation in machine learning, emphasizing the importance of feature expansion and kernel methods.

Gradient Descent and Linear Regression

Covers stochastic gradient descent, linear regression, regularization, supervised learning, and the iterative nature of gradient descent.

Other regularizations + the Lasso

Explores diverse regularization approaches, including the L0 quasi-norm and the Lasso method, discussing variable selection and efficient algorithms for optimization.