Lecture

Linear Models: Least Squares

Related lectures (29)

Explores least squares in linear regression, hypothesis testing, outliers, and model assumptions.

Explores linear models, overfitting, and the importance of feature expansion and adding more data to reduce overfitting.

Linear Regression: Statistical Inference and Regularization

Covers the probabilistic model for linear regression and the importance of regularization techniques.

Linear Models: Ridge, OLS and LASSO

Covers linear models like Ridge, OLS, and LASSO, explaining singular values and regression analysis.

Regression Diagnostics

Covers regression diagnostics for linear models, emphasizing the importance of checking assumptions and identifying outliers and influential observations.

Generalized Linear Models

Covers probability, random variables, expectation, GLMs, hypothesis testing, and Bayesian statistics with practical examples.

Linear Models: Introduction

Introduces linear models, regression, Gaussian distribution, linearity, and model generalization.

Likelihood Estimation and Least Squares

Introduces simple and multiple normal linear regression, and maximum likelihood estimation with practical examples.

Linear Models for Classification: Multi-Class Extensions

Covers linear models for multi-class classification, focusing on logistic regression and evaluation metrics.

Least Squares Solutions

Explains the concept of least squares solutions and their application in finding the closest solution to a system of equations.

Nonlinear Machine Learning: k-Nearest Neighbors and Feature Expansion

Covers the transition from linear to nonlinear models, focusing on k-NN and feature expansion techniques.

Linear Algebra Basics

Covers fundamental concepts in linear algebra, including linear equations, matrix operations, determinants, and vector spaces.

Linear Models: Least Squares and QR Factorization

Covers least squares, QR factorization, linear models, and regression analysis with applications to experimental data.

Linear Regression: Absence or Presence of Covariates

Explores linear regression with and without covariates, covering models captured by independent distributions and tools like subspaces and orthogonal projections.

Geometry and Least Squares

Discusses the geometry of least squares, exploring row and column perspectives, hyperplanes, projections, residuals, and unique vectors.

Regression Methods: Model Building and Diagnostics

Explores regression methods, covering model building, diagnostics, inference, and analysis of variance.

Linear Regression: Basics and Estimation

Covers the basics of linear regression and how to solve estimation problems using least squares and matrix notation.

Linear Regression Basics

Covers the basics of linear regression, instrumental variables, heteroskedasticity, autocorrelation, and Maximum Likelihood Estimation.

Linear Regression: Estimation and Inference

Explores linear regression estimation, linearity assumptions, and statistical tests in the context of model comparison.

Least Squares Solutions

Covers least squares solutions for linear systems using matrix operations and normal systems, illustrated with examples.