Lectures related to Differential entropy

Explores mutual information and entropy calculation between random variables.

Entropy and the Second Law of Thermodynamics

Covers entropy, its definition, and its implications in thermodynamics.

Entropy Bounds: Conditional Entropy Theorems

Explores entropy bounds, conditional entropy theorems, and the chain rule for entropies, illustrating their application through examples.

Conditional Entropy: Review and Definitions

Covers conditional entropy, weather conditions, function entropy, and the chain rule.

Entropy and Information Theory

Explores entropy, uncertainty, coding theory, and data compression applications.

Information Theory: Entropy and Capacity

Covers concepts of entropy, Gaussian distributions, and channel capacity with constraints.

Energy Minimization in Biological Systems: Equilibrium Models

Covers energy minimization models in biological systems, focusing on equilibrium and the roles of entropy and hydrophobicity.

Model Selection Criteria: AIC, BIC, Cp

Explores model selection criteria like AIC, BIC, and Cp in statistics for data science.

Geodesic Convexity: Theory and Applications

Explores geodesic convexity in metric spaces and its applications, discussing properties and the stability of inequalities.

Information Theory: Channel Capacity and Convex Functions

Explores channel capacity and convex functions in information theory, emphasizing the importance of convexity.

Introduction: Course Structure and Fundamentals of Computing

Explores the role of Computing in society and the basics of computing, algorithms, communication systems, and computer security.

Probability Distribution and Entropy

Explains probability distribution, entropy, and Gibbs free entropy, along with the Weiss model.

Cryptography Fundamentals

Delves into the core principles of cryptography, emphasizing the challenges of key management and the impact of technology advancement on security.

Generative Models: Self-Attention and Transformers

Covers generative models with a focus on self-attention and transformers, discussing sampling methods and empirical means.

Thermodynamics: Fundamentals and Applications

Explores the basics of thermodynamics, including energy transformation, laws, and entropy.

Entropy and Data Compression: Huffman Coding Techniques

Discusses entropy, data compression, and Huffman coding techniques, emphasizing their applications in optimizing codeword lengths and understanding conditional entropy.

Cavity and variational methods

Explores the cavity method for the run-fill Ising model and the variational method for approximating the Boltzmann distribution.

Conditional Entropy and Data Compression Techniques

Discusses conditional entropy and its role in data compression techniques.

Rigidity in Negative Curvature

Delves into the rigidity of negatively curved manifolds and the interplay between curvature and symmetry.

Conditional Entropy and Information Theory Concepts

Discusses conditional entropy and its role in information theory and data compression.