Covers Markov processes, transition densities, and distribution conditional on information, discussing classification of states and stationary distributions.
Delves into Markov chains by analyzing a scenario with two fleas moving in opposite directions, exploring transition matrices and probabilities over time.