Hidden Markov Models: PrimerIntroduces Hidden Markov Models, explaining the basic problems and algorithms like Forward-Backward, Viterbi, and Baum-Welch, with a focus on Expectation-Maximization.
Lindblad equationCovers the interpretation of the Lindblad equation and its unitary part in quantum gases.
Markov Chain GamesExplores Markov chain games, hitting probabilities, and expected hitting times in a target set.
Probability and StatisticsIntroduces probability, statistics, distributions, inference, likelihood, and combinatorics for studying random events and network modeling.
Sunny Rainy Source: Markov ModelExplores a first-order Markov model using a sunny-rainy source example, demonstrating how past events influence future outcomes.
Probability InequalitiesExplores probability inequalities, convergence types, and moment generating functions for distribution approximation.