Evaluation of Binary ClassifiersDiscusses the evaluation of binary classifiers, including recall, sensitivity, specificity, ROC curves, and performance measures.
Support Vector Machines: SVMsExplores Support Vector Machines, covering hard-margin, soft-margin, hinge loss, risks comparison, and the quadratic hinge loss.
Decision and regression treesExplores decision and regression trees, impurity measures, learning algorithms, and implementations, including conditional inference trees and tree pruning.
Bagging and Random ForestsCovers ensembling, bagging, random forests, variable importance, and OOB cross-validation in machine learning.
Boosting: Adaboost AlgorithmCovers boosting with a focus on the Adaboost algorithm, forward stagewise additive modeling, and gradient tree boosting.
K-means Algorithm: DemoIntroduces the k-means algorithm for clustering data points based on centroids and iterative updates.
Training Neural NetworksCovers the training of neural networks using stochastic gradient descent, chain rules, gradients computation, weight decay, and dropout.
Convolutional Neural NetworksExplores convolutional neural networks, covering convolution, cross-correlation, max pooling, layer structure, and examples like LeNet5 and AlexNet.