Entropy, Relative entropy, Mutual information, Source entropy rate, Kraft
inequality, Huffman code, Typical sequences and the asymptotic equipartition
property, Lempel-Ziv coding, Channel capacity, Noisy channel coding theorem
for discrete memoryless channels, Jointly typical sequences, Error exponents,
Joint source-channel coding theorem, Feedback, Low-density parity check
codes and iterative decoding, Polar codes and successive decoding, Multiple
access channels, Broadcast channels, Distributed source coding.