Lecture

Performance Evaluation: Bootstrap and Performance Metrics

Related lectures (32)

Performance Criteria: Confusion Matrix, Recall, Precision, Accuracy

Explores performance criteria in supervised learning, emphasizing precision, recall, and specificity in model evaluation.

Evaluation Protocols

Explores evaluation protocols in machine learning, including recall, precision, accuracy, and specificity, with real-world examples like COVID-19 testing.

Information Retrieval Basics: Document Frequency and Precision

Introduces information retrieval basics, emphasizing document frequency and precision in evaluating retrieval quality.

Quantifying Performance: Misclassification and F-Measure

Covers quantifying performance through true positives, false negatives, and false positives in machine learning.

Linear Regression: Basics

Covers the basics of linear regression, binary and multi-class classification, and evaluation metrics.

Information Retrieval Basics: Document Length and Normalization

Explores document length, normalization, bias compensation, and retrieval model evaluation in information retrieval.

Evaluating Information Retrieval

Explains the evaluation of information retrieval models, including recall, precision, F-Measure, and the precision/recall tradeoff.

Evaluation of Binary Classifiers

Discusses the evaluation of binary classifiers, including recall, sensitivity, specificity, ROC curves, and performance measures.

Generalized Linear Regression: Classification

Explores Generalized Linear Regression, Classification, confusion matrices, ROC curves, and noise in data.

Linear Models for Classification: Multi-Class Extensions

Covers linear models for multi-class classification, focusing on logistic regression and evaluation metrics.

Understanding ROC Curves

Explores the ROC curve, True Positive Rate, False Positive Rate, and prediction probabilities in classification models.

Fairness in Machine Learning

Explores sources of unfairness in machine learning, the importance of fairness metrics, and evaluating model predictions using various fairness metrics.

Machine Learning in Human Rights: HURIDOCS

Explores machine learning in human rights, focusing on defining goals, handling false positives and negatives, and ensuring transparency and trust.

Evaluation in NLP

Delves into NLP evaluation, covering gold standards, precision, recall, and statistical significance.

Diagnostic Tests: Sensitivity and Specificity

Explains Sensitivity, Specificity, ROC curve, and Precision in diagnostic tests.

The Riesz-Kakutani Theorem

Explores the construction of measures, emphasizing positive functionals and their connection to the Riesz-Kakutani Theorem.

Applied Machine Learning: Features and Models

Explores data collection, feature selection, model building, and performance evaluation in machine learning, emphasizing feature engineering and model selection.

Classification: Decision Trees and kNN

Introduces decision trees and k-nearest neighbors for classification tasks, exploring metrics like accuracy and AUC.

Machine Learning Basics

Introduces machine learning basics, including data collection, model evaluation, and feature normalization.

Genome-wide Association Studies: Statistical Analysis

Explains the statistical analysis of Genome-wide Association Studies and the importance of adjusting for multiple testing.