Formal & Physical Sciences Science — General & HistoryENBut what is cross-entropy? | Compression is Intelligence Part 23Blue1BrownJuly 16, 2026 33 min★ ★ ★ ★ ★ 5/5Cross-EntropyInformation TheoryCompression
Formal & Physical Sciences Science — General & HistoryENReinventing Entropy | Compression is Intelligence Part 13Blue1BrownJune 7, 2026 32 min★ ★ ★ ★ ★ 5/5EntropyInformation TheoryCompression
Formal & Physical Sciences Science — General & HistoryENMikhail Gromov - 2/4 Generation, Transformation, Transmission, Memorization, Storage and (...)Mikhail GromovApril 14, 2026 97 min★ ★ ★ ★ ☆ 4/5Information TheoryBiologyMathematics
Formal & Physical Sciences Science — General & HistoryENJohn Conway - LexicodesJohn ConwayFebruary 25, 2026 15 min★ ★ ★ ★ ☆ 4/5LexicodesCombinatorial Game TheoryNim-Addition
Formal & Physical Sciences Science — General & HistoryENIntroduction to Information Theory (Lecture 1) by Jaikumar RadhakrishnanJaikumar RadhakrishnanNovember 18, 2025 96 min★ ★ ★ ★ ★ 5/5Information TheoryShannon EntropyPrefix-Free Codes
Formal & Physical Sciences Science — General & HistoryENError Correcting Codes problems || @ CMU || Recitation 7 of CS Theory ToolkitRyan O'DonnellMarch 2, 2022 78 min★ ★ ★ ★ ☆ 4/5Error Correcting CodesHadamard CodeLinear Codes
Formal & Physical Sciences Science — General & HistoryENMutual Information || @ CMU || Lecture 24b of CS Theory ToolkitRyan O'DonnellJuly 6, 2020 28 min★ ★ ★ ★ ★ 5/5Mutual InformationInformation TheoryEntropy
Formal & Physical Sciences Science — General & HistoryENEntropy || @ CMU || Lecture 24a of CS Theory ToolkitRyan O'DonnellJuly 3, 2020 24 min★ ★ ★ ★ ★ 5/5EntropyInformation TheoryShannon Entropy
Formal & Physical Sciences Science — General & HistoryENAsymptotically "Good" Codes || @ CMU || Lecture 11e of CS Theory ToolkitRyan O'DonnellApril 9, 2020 10 min★ ★ ★ ★ ☆ 4/5Error-Correcting CodesCoding TheoryAsymptotic Rate
Formal & Physical Sciences Science — General & HistoryENReed--Solomon Codes || @ CMU || Lecture 11d of CS Theory ToolkitRyan O'DonnellApril 8, 2020 12 min★ ★ ★ ★ ☆ 4/5Reed-SolomonError-Correcting CodesPolynomials
Formal & Physical Sciences Science — General & HistoryENHamming Code and Hadamard Code || @ CMU || Lecture 11c of CS Theory ToolkitRyan O'DonnellApril 7, 2020 21 min★ ★ ★ ★ ☆ 4/5Coding TheoryHamming CodeHadamard Code
Formal & Physical Sciences Science — General & HistoryENLinear Error Correcting Codes || @ CMU || Lecture 11b of CS Theory ToolkitRyan O'DonnellApril 6, 2020 20 min★ ★ ★ ★ ☆ 4/5Coding TheoryLinear CodesError Correction
Formal & Physical Sciences Science — General & HistoryENError Correcting Codes || @ CMU || Lecture 11a of CS Theory ToolkitRyan O'DonnellMarch 31, 2020 16 min★ ★ ★ ★ ☆ 4/5Error Correcting CodesHamming DistanceCoding Theory
Formal & Physical Sciences Science — General & HistoryENExplaining the Kullback-Liebler divergence through secret codesBen LambertMay 15, 2018 10 min★ ★ ★ ★ ☆ 4/5Kullback-Leibler DivergenceInformation TheoryBayesian Statistics
