Lectures related to Markov Chains: State Classification

Covers the classification of states in discrete-time Markov chains.

Explores Markov chains and their applications in algorithms, focusing on user impatience and faithful sample generation.

Discrete-Time Markov Chains: Definitions

Covers the definitions and state probabilities of discrete-time Markov chains.

Asymptotic Behavior of Markov Chains

Explores recurrent states, invariant distributions, convergence to equilibrium, and PageRank algorithm.

Birth & Death Chains: Analysis & Probabilities

Explores birth and death chains, hitting probabilities, and expected game durations in Markov chains.

Stochastic Models for Communications: Discrete-Time Markov Chains - First Passage Time

Explores discrete-time Markov chains, emphasizing the concept of first passage time in communication systems.

Markov Chains: Ergodic Chains Examples

Covers stochastic models for communications, focusing on discrete-time Markov chains.

Markov Chains and Algorithm Applications

Covers Markov chains and their applications in algorithms, focusing on Markov Chain Monte Carlo sampling and the Metropolis-Hastings algorithm.

Discrete-Time Markov Chains: Definitions

Covers the definitions and state probabilities of discrete-time Markov chains.

Periodic Table of the Elements

Explores the periodic table of the elements, including Fe, Co, Ni, Cu, Zn, Ru, Rh, Pd, Ag, Cd, Os, Ir, Pt, Au, Hg, Ds, Rg, Uub.

Untitled

Markov Chains: Definitions and State Probabilities

Covers the definitions and state probabilities of discrete-time Markov chains.

Markov Chains and Algo Applications

Covers Markov chains, Metropolis algorithm, Glauber dynamics, and heat bath dynamics.

Continuous-Time Markov Chains: Definitions and State Probabilities

Covers the definitions and state probabilities of continuous-time Markov chains.

Markov Chains: State Classification

Covers the classification of states in Markov chains.

Atomic Structure: Quantum Mechanics

Covers atomic theory, Schrödinger equation, quantum numbers, electron configurations, and periodic properties of elements.

Irreducible periodic case

Explores convergence results for periodic case reversibility in Markov chains, covering irreducible chains, positive recurrence, reversible processes, and random walks on finite graphs.

Stochastic Models: Absorbing Markov Chains Examples

Covers examples of absorbing Markov chains in discrete time.

Markov Chains: Theory and Applications

Covers the theory and applications of Markov chains in modeling random phenomena and decision-making under uncertainty.