Lecture

Kernel Methods: Understanding Overfitting and Model Selection

Related lectures (31)

Covers Kernel Methods in Machine Learning, focusing on overfitting, model selection, cross-validation, regularization, kernel functions, and SVM.

Machine Learning Fundamentals: Regularization and Cross-validation

Explores overfitting, regularization, and cross-validation in machine learning, emphasizing the importance of feature expansion and kernel methods.

Kernel Methods: Machine Learning

Explores kernel methods in machine learning, emphasizing their application in regression tasks and the prevention of overfitting.

Model Complexity and Overfitting in Machine Learning

Covers model complexity, overfitting, and strategies to select appropriate machine learning models.

Nonlinear ML Algorithms

Introduces nonlinear ML algorithms, covering nearest neighbor, k-NN, polynomial curve fitting, model complexity, overfitting, and regularization.

Overfitting, Cross-validation, Regularization

Explores overfitting, cross-validation, and regularization in machine learning, emphasizing model complexity and the importance of regularization strength.

Cross-Validation: Techniques and Applications

Explores cross-validation, overfitting, regularization, and regression techniques in machine learning.

Overfitting in Supervised Learning: Case Studies and Techniques

Addresses overfitting in supervised learning through polynomial regression case studies and model selection techniques.

Linear Regression: Statistical Inference and Regularization

Covers the probabilistic model for linear regression and the importance of regularization techniques.

Polynomial Regression: Basics and Regularization

Covers the basics of polynomial regression and regularization to prevent overfitting.

Kernel Methods in Machine Learning: Kernel Regression and SVM

Discusses kernel methods in machine learning, focusing on kernel regression and support vector machines, including their formulations and applications.

Probabilistic Linear Regression

Explores probabilistic linear regression, covering joint and conditional probability, ridge regression, and overfitting mitigation.

Supervised Learning in Financial Econometrics

Explores supervised learning in financial econometrics, covering linear regression, model fitting, potential problems, basis functions, subset selection, cross-validation, regularization, and random forests.

Linear Regression and Logistic Regression

Covers linear and logistic regression for regression and classification tasks, focusing on loss functions and model training.

Kernel Methods

Covers overfitting, model selection, validation methods, kernel functions, and SVM concepts.

Cross-validation & Regularization

Explores polynomial curve fitting, kernel functions, and regularization techniques, emphasizing the importance of model complexity and overfitting.

Linear Regression

Covers the concept of linear regression, including polynomial regression and hyperparameters selection.

Linear and Ridge Regression

Covers linear and ridge regression, overfitting, hyperparameters, and test sets.

Regression Trees and Ensemble Methods in Machine Learning

Discusses regression trees, ensemble methods, and their applications in predicting used car prices and stock returns.

Linear Systems: Modeling and Identification

Covers auto-encoders, linear systems modeling, system identification, and recursive least squares.