Lecture

Model Evaluation and Selection

Related lectures (31)

Model Complexity and Overfitting in Machine Learning

Covers model complexity, overfitting, and strategies to select appropriate machine learning models.

Specification Testing and Machine Learning

Explores specification testing, machine learning, overfitting, regularization, prediction tests, and variable selection.

Supervised Learning: Regression Methods

Explores supervised learning with a focus on regression methods, including model fitting, regularization, model selection, and performance evaluation.

Model Selection: Generalization and Validation

Explores generalization, model selection, and validation in machine learning, emphasizing the importance of unbiased model evaluation.

Model Selection Criteria: AIC, BIC, Cp

Explores model selection criteria like AIC, BIC, and Cp in statistics for data science.

Model Selection and Evaluation

Discusses the experimental framework for selecting and evaluating supervised learning models to prevent overfitting.

Model Selection: Evaluation and Generalization

Explores model selection, evaluation, and generalization in machine learning, emphasizing unbiased performance estimation and the risks of over-learning.

Overfitting in Supervised Learning: Case Studies and Techniques

Addresses overfitting in supervised learning through polynomial regression case studies and model selection techniques.

Model Assessment and Hyperparameter Tuning

Explores model assessment, hyperparameter tuning, and resampling strategies in machine learning.

Kernel Methods: Understanding Overfitting and Model Selection

Discusses kernel methods, focusing on overfitting, model selection, and kernel functions in machine learning.

Machine Learning Basics

Introduces machine learning basics, including data collection, model evaluation, and feature normalization.

Decision Trees: Classification

Explores decision trees for classification, entropy, information gain, one-hot encoding, hyperparameter optimization, and random forests.

Model Evaluation

Explores underfitting, overfitting, hyperparameters, bias-variance trade-off, and model evaluation in machine learning.

Model Evaluation

Delves into model evaluation, covering theory, training error, prediction error, resampling methods, and information criteria.

Machine Learning Fundamentals: Regularization and Cross-validation

Explores overfitting, regularization, and cross-validation in machine learning, emphasizing the importance of feature expansion and kernel methods.

Data Representation: BoW and Imbalanced Data

Covers overfitting, model selection, validation, cross-validation, regularization, kernel regression, and data representation challenges.

Simple validation, cross-validation, leave-one-out

Introduces techniques for obtaining unbiased risk estimates of learned predictors and their application for hyperparameter tuning.

Regression Trees and Ensemble Methods in Machine Learning

Discusses regression trees, ensemble methods, and their applications in predicting used car prices and stock returns.

Model Evaluation: K-Nearest Neighbor

Explores model evaluation with K-Nearest Neighbor, covering optimal k selection, similarity metrics, and performance metrics for classification models.

Document Analysis: Topic Modeling

Explores document analysis, topic modeling, and generative models for data generation in machine learning.