Lecture

Markov Chain Monte Carlo

Related lectures (32)

Markov Chains: Ergodicity and Stationary Distribution

Explores ergodicity and stationary distribution in Markov chains, emphasizing convergence properties and unique distributions.

Stochastic Models for Communications

Covers stochastic models for communications, focusing on random variables, Markov chains, Poisson processes, and probability calculations.

Theory of MCMC

Covers the theory of Markov Chain Monte Carlo (MCMC) sampling and discusses convergence conditions, transition matrix choice, and target distribution evolution.

Probability & Stochastic Processes

Covers applied probability, stochastic processes, Markov chains, rejection sampling, and Bayesian inference methods.

Probability Convergence

Explores probability convergence, discussing conditions for random variable sequences to converge and the uniqueness of convergence.

Markov Chains: Stationary Distributions

Explores Markov chains and stationary distributions, emphasizing the importance of identifying them for improving convergence.

Markov Chains and Algorithm Applications

Covers Markov chains and their applications in algorithms, focusing on Markov Chain Monte Carlo sampling and the Metropolis-Hastings algorithm.

Uniform Integrability and Convergence

Explores uniform integrability, convergence theorems, and the importance of bounded sequences in understanding the convergence of random variables.

Markov Chains: Properties and Expectations

Explores Markov chains' properties, expectations, and recurrence in Poisson processes.

Coupling of Markov Chains: Ergodic Theorem

Explores the coupling of Markov chains and the proof of the ergodic theorem, emphasizing distribution convergence and chain properties.

Probability Inequalities

Explores probability inequalities, convergence types, and moment generating functions for distribution approximation.

Conditional Expectation: Grouping Lemma

Explores conditional expectation, the grouping lemma, and the law of large numbers.

Elements of Statistics: Memorylessness, Stationary Processes, Estimation using MLE

Explores memorylessness in distributions, stationary processes, and estimation using MLE.

Law of Large Numbers: Strong Convergence

Explores the strong convergence of random variables and the normal distribution approximation in probability and statistics.

Markov Chains: Reversibility and Stationary Distribution

Explores reversibility in Markov chains and its impact on the stationary distribution, highlighting the complexity of non-reversible chains.

NISQ and IBM Q

Explores NISQ devices and IBM Q, covering noisy quantum circuits, qubit technologies, and quantum algorithm development.

Lindblad equation

Covers the interpretation of the Lindblad equation and its unitary part in quantum gases.

Markov Chains: Reversibility & Convergence

Covers Markov chains, focusing on reversibility, convergence, ergodicity, and applications.

Markov Chains: Theory and Applications

Covers the theory and applications of Markov chains in modeling random phenomena and decision-making under uncertainty.

Expected Number of Visits in State

Covers the criterion for recurrence in infinite chains based on the expected number of visits in a state.