Markov Chain ConvergenceExplores Markov chain convergence, emphasizing invariant distribution, Law of Large Numbers, and mean rewards computation.
Doob's MartingaleCovers the concept of Doob's martingale and its properties, including integrability and convergence theorem.
Doob's Decomposition TheoremCovers Doob's decomposition theorem for submartingales and explores Brownian motion properties, quadratic variation, and continuous martingales.
Optional Stopping TheoremExplores stopping times, the optional stopping theorem, F-measurable random variables, and martingales.