Lectures related to Kullback–Leibler divergence

Covers building decision trees to classify mushrooms as poisonous or not.

Covers information measures like entropy, joint entropy, and mutual information in information theory and data processing.

Information Measures

Covers information measures like entropy, Kullback-Leibler divergence, and data processing inequality, along with probability kernels and mutual information.

Nonlinear Equations: Bisection and Fixed-Point Methods

Explores nonlinear equations, bisection, fixed-point methods, error control, and graphical interpretations of fixed points.

Neural networks under SGD

Explores the optimization of neural networks using Stochastic Gradient Descent (SGD) and the concept of dual risk versus empirical risk.

Divergence Theorem: Green Identities in R²

Explores the divergence theorem and corollaries related to Green identities in the plane, demonstrating their application through examples.

Decision Trees: Classification

Explores decision trees for classification, entropy, information gain, one-hot encoding, hyperparameter optimization, and random forests.

Information Measures

Covers information measures like entropy and Kullback-Leibler divergence.

Untitled

Vector Analysis: Scalar Fields

Covers the analysis of scalar fields, including divergence, gradient, and Laplacian.

Model Selection Criteria: AIC, BIC, Cp

Explores model selection criteria like AIC, BIC, and Cp in statistics for data science.

Symmetries and Conservation Laws

Covers symmetries and conservation laws in fluid dynamics, emphasizing the importance of maximizing symmetries in ideal fluid systems.

Boltzmann Machines: Generating Synthetic Data in Finance

Delves into using Boltzmann machines to generate synthetic financial data effectively.

Vector Calculus Review: Maxwell Equations

Covers a review of vector calculus and the Maxwell equations in electromagnetism.

Advanced Information Theory: F-Divergences and Generalization Error

Covers f-divergences and generalization error in advanced information theory.

Curve Integrals: Gauss/Green Theorem

Explores the application of the Gauss/Green theorem to calculate curve integrals along simple closed curves.

Supervised Learning: Decision Trees

Covers supervised learning with decision trees and feature selection for classification.

Periodic Solutions in Planar Systems

Explores the absence and existence of periodic solutions in planar systems.

Voristicand Characterization of KL Divergences

Explores exploration bias and generalization bound in KL divergences, emphasizing mathematical proofs and implications.

Divergence Explained: Lightboard 2-4

Explores how sources and sinks affect the divergence of vector fields.