Lectures related to Principle of maximum entropy

Explores mutual information and entropy calculation between random variables.

Thermodynamic Identity: Entropy and Energy

Explores the thermodynamic identity, entropy-temperature relationship, and pressure definition, illustrating key principles with practical examples.

Energy Minimization in Biological Systems: Equilibrium Models

Covers energy minimization models in biological systems, focusing on equilibrium and the roles of entropy and hydrophobicity.

Entropy and the Second Law of Thermodynamics

Covers entropy, its definition, and its implications in thermodynamics.

Probability Distribution and Entropy

Explains probability distribution, entropy, and Gibbs free entropy, along with the Weiss model.

Variational Formulation: Information Measures

Explores variational formulation for measuring information content and divergence between probability distributions.

Generative Models: Boltzmann Machine

Covers generative models, focusing on Boltzmann machines and constrained maximization using Lagrange multipliers.

Banach Spaces and Thermodynamic Formalism

Introduces Banach spaces for maximal entropy in billiard maps, discussing spectral bounds, norms, and measure construction.

Untitled

Introduction to Data Science

Introduces the basics of data science, covering decision trees, machine learning advancements, and deep reinforcement learning.

Information Theory: Quantifying Messages and Source Entropy

Covers quantifying information in messages, source entropy, common information, and communication channel capacity.

Entropy and Information Theory

Explores entropy, uncertainty, coding theory, and data compression applications.

Entropy and KL Divergence

Explores entropy, KL divergence, and maximum entropy principle in probability models for data science.

Information Theory: Entropy and Capacity

Covers concepts of entropy, Gaussian distributions, and channel capacity with constraints.

Replica Symmetry Breaking: Full Solution & Condensation

Explores Replica Symmetry Breaking in the Random Energy Model, discussing configurational entropy and condensation.

Phase Transitions: Understanding Thermodynamic Stability

Explores phase transitions in thermodynamics, focusing on stability criteria and real-world applications.

Generative Models: Self-Attention and Transformers

Covers generative models with a focus on self-attention and transformers, discussing sampling methods and empirical means.

Interpretation of Entropy

Explores the concept of entropy expressed in bits and its relation to probability distributions, focusing on information gain and loss in various scenarios.

Information Measures: Entropy and Information Theory

Explains how entropy measures uncertainty in a system based on possible outcomes.

Classical Thermodynamics: Fundamentals and Principles

Covers classical thermodynamics fundamentals, including boundary conditions, internal energy, entropy, and equilibrium principles.