00:00:00 Introduction
00:01:25 Entropy, Relative Entropy, and Mutual Information
00:03:16 Asymptotic Equipartition Property (AEP)
00:04:22 Entropy Rates of a Stochastic Process
00:05:37 Data Compression
00:07:09 Gambling and Data Compression
00:08:50 Channel Capacity
00:10:44 Differential Entropy
00:12:13 Gaussian Channel
00:13:37 Rate Distortion Theory
00:15:08 Information Theory and Statistics
00:16:38 Maximum Entropy
00:17:54 Universal Source Coding
00:19:14 Kolmogorov Complexity
00:20:42 Network Information Theory
00:22:19 Information Theory and Portfolio Theory
00:23:43 Inequalities in Information Theory
00:25:03 Outro
