Exploration BiasExplores regularization, learning algorithms, and subgaussian assumptions in machine learning.
Markov Chain GamesExplores Markov chain games, hitting probabilities, and expected hitting times in a target set.
Hidden Markov Models: PrimerIntroduces Hidden Markov Models, explaining the basic problems and algorithms like Forward-Backward, Viterbi, and Baum-Welch, with a focus on Expectation-Maximization.
Sunny Rainy Source: Markov ModelExplores a first-order Markov model using a sunny-rainy source example, demonstrating how past events influence future outcomes.
NISQ and IBM QExplores NISQ devices and IBM Q, covering noisy quantum circuits, qubit technologies, and quantum algorithm development.
Probability InequalitiesExplores probability inequalities, convergence types, and moment generating functions for distribution approximation.