Explores the Law of Total Probability and its applications in real-world scenarios, introducing key concepts in probability theory.
Covers entropy, source coding, encoding maps, decodability, prefix-free codes, and Kraft-McMillan's inequality.
Explores the Kraft-McMillan theorem, proving the existence of uniquely decodable prefix-free codes.
Covers Shannon-Fano codes, a method for uniquely decodable and prefix-free coding, and discusses their optimality compared to the entropy.
Explores the chain rule for entropy, decomposing uncertainty in random variables and illustrating its application with examples.
Explores the Source Coding Theorem, entropy, Huffman coding, and conditioning's impact on entropy reduction.
Explores perfect secrecy, the one-time pad encryption method, attacks on encryption systems, and the Vigenère cipher.
