Lecture

Markov chains

Related lectures (32)

Probability & Stochastic Processes

Covers applied probability, stochastic processes, Markov chains, rejection sampling, and Bayesian inference methods.

Monte Carlo: Markov Chains

Covers unsupervised learning, dimensionality reduction, SVD, low-rank estimation, PCA, and Monte Carlo Markov Chains.

Max Entropy and Monte Carlo

Explores max entropy, Shannon's entropy, Lagrange multipliers, and Monte Carlo sampling techniques.

Monte Carlo Methods: Thermal Radiation Applications

Discusses the application of Monte Carlo methods in thermal radiation analysis, focusing on probability functions and numerical integration techniques.

Markov Chains and Algorithm Applications

Covers Markov chains and their applications in algorithms, focusing on Markov Chain Monte Carlo sampling and the Metropolis-Hastings algorithm.

Radiative Exchange: Specular View Factors

Covers specular view factors, radiative exchange, energy transfer, and numerical integration methods in thermal radiation.

Estimating R

Covers the estimation of R, including the continuity theorem and limit laws for random variables.

Markov Chains: Introduction and Properties

Covers the introduction and properties of Markov chains, including transition matrices and stochastic processes.

Markov Chains: Transition Probabilities

Explores Markov chains, transition matrices, distribution, and random walks.

Factorial design II

Explores the visualization and selection of effects in a 2N Full Factorial Design using the Normal plot method.

Stochastic Processes: Markov Chains

Covers stochastic processes, focusing on Markov chains and their applications in real-world scenarios.

Markov Chains: Applications and Sampling Methods

Covers the basics of Markov chains and their algorithmic applications.

MCMC Examples and Error Estimation

Covers Markov Chain Monte Carlo examples and error estimation methods.

Applied Probability & Stochastic Processes

Covers applied probability, Markov chains, and stochastic processes, including transition matrices, eigenvalues, and communication classes.

Stationary Distribution in Markov Chains

Explores the concept of stationary distribution in Markov chains, discussing its properties and implications, as well as the conditions for positive-recurrence.

Bonus Malus System: Transition Probabilities

Explores the Bonus Malus system for insurance premiums and Markov chain transition probabilities.

Quantum Monte Carlo: Basic Concepts

Covers the basic concepts of Quantum Monte Carlo and its application in spin chains, Markov chains, and Monte Carlo simulations.

Markov Chain Monte Carlo: Rejection Sampling

Explores rejection sampling for generating sample values from a target distribution, along with Bayesian inference using MCMC.

Markov Chains: Theory and Applications

Covers the theory and applications of Markov chains in modeling random phenomena and decision-making under uncertainty.

Continuous Random Variables

Covers continuous random variables, probability density functions, and distributions, with practical examples.