Lecture

Design Optimisation and Orthogonality: Multilinear Regression

Related lectures (30)

Introduces regularization techniques to prevent overfitting in machine learning models.

Ridge Regression: Penalised Least Squares

Explores Ridge Regression for handling multicollinearity and the LASSO method for model selection.

Explores linear models, overfitting, and the importance of feature expansion and adding more data to reduce overfitting.

Introduction to Machine Learning: Supervised Learning

Introduces supervised learning, covering classification, regression, model optimization, overfitting, and kernel methods.

Regression Diagnostics

Covers regression diagnostics for linear models, emphasizing the importance of checking assumptions and identifying outliers and influential observations.

Linear Models for Classification: Logistic Regression and SVM

Covers linear models for classification, focusing on logistic regression and support vector machines.

Nonparametric Regression

Covers nonparametric regression, scatterplot smoothing, kernel methods, and bias-variance tradeoff.

Provable Benefits of Overparameterization in Model Compression

Explores the provable benefits of overparameterization in model compression, emphasizing the efficiency of deep neural networks and the importance of retraining for improved performance.

Assessing Significance and Fit

Covers confidence intervals, R2, and examples on cement heat evolution and car horsepower-MPG relationships.

Linear Models: Introduction

Introduces linear models, regression, Gaussian distribution, linearity, and model generalization.

Multicollinearity: Dangers and Remedies

Explores the dangers of multicollinearity in linear models and discusses diagnostic methods and remedies.

Nested Model Selection

Explores nested model selection in linear models, comparing models through sums of squares and ANOVA, with practical examples.

Linear Models: Least Squares

Explores linear models, least squares, Gaussian vectors, and model selection methods.

Introduction to Machine Learning: Linear Models

Introduces linear models for supervised learning, covering overfitting, regularization, and kernels, with applications in machine learning tasks.

Introduction to Machine Learning

Covers the basics of Machine Learning, including recognizing hand-written digits, supervised classification, decision boundaries, and polynomial curve fitting.

Likelihood Estimation and Least Squares

Introduces simple and multiple normal linear regression, and maximum likelihood estimation with practical examples.

Linear Models: LASSO and AMP

Covers linear problems, LASSO, and AMP in supervised learning, including Generalized Linear Models and N-dimensional models.

Linear Models for Classification

Explores linear models for classification, logistic regression, and gradient descent in machine learning.

Machine Learning Fundamentals: Regularization and Cross-validation

Explores overfitting, regularization, and cross-validation in machine learning, emphasizing the importance of feature expansion and kernel methods.

Non-Convex Optimization: Techniques and Applications

Covers non-convex optimization techniques and their applications in machine learning.