Date
|
Topic
|
Lecturer
|
Place
|
|
21.09.2011
|
Block diagram of a communications system, chance variables, entropy, relative entropy
|
Amos Lapidoth
|
ETZ E9
|
|
28.09.2011
|
Concave functions, Jensen's inequality, divergence inequality, joint entropy, conditional entropy, mutual information, chain rule
|
Amos Lapidoth
|
ETZ E9
|
|
5.10.2011
|
Fano's Inequality, source codes, nonsingular codes, extension of a code, uniquely decodable codes, prefix-free codes, Kraft's Inequality
|
Amos Lapidoth
|
ETZ E9
|
|
12.10.2011
|
Converse to Kraft's inequality, bounds on the expected description length of one-to-variable source-codes, mismatched source-coding
|
Amos Lapidoth
|
ETZ E9
|
|
19.10.2011
|
Huffman's procedure, proof of optimality of Huffman codes, typicality, strong/weak typicality, type class
|
Amos Lapidoth
|
ETZ E9
|
|
26.10.2011
|
Properties of the typical set, the source coding theorem
|
Amos Lapidoth
|
ETZ E9
|
|
2.11.2011
|
Discrete memoryless channels, the binary symmetric channel, the binary erasure channel, channel capacity, weakly symmetric channels
|
Amos Lapidoth
|
ETZ E9
|
|
9.11.2011
|
Markov chains, data processing inequalities, log-sum inequality, concavity and convexity properties of entropy, relative entropy and mutual information
|
Amos Lapidoth
|
ETZ E9
|
|
16.11.2011
|
Kuhn-Tucker conditions, definition of achievable rates and channel capacity, converse part of the channel coding theorem
|
Amos Lapidoth
|
ETZ E9
|
|
23.11.2011
|
Joint weak typicality, direct part of the channel coding theorem.
|
Amos Lapidoth
|
ETZ E9
|
|
30.11.2011
|
Feedback in DMCs, scalar quantization, vector quantization, main theorem of rate-distortion theory, the rate-distortion function
|
Amos Lapidoth
|
ETZ E9
|
|
7.12.2011
|
Direct part of the rate-distortion theorem
|
Amos Lapidoth
|
ETZ E9
|
|
14.12.2011
|
Converse part of the rate-distortion theorem, source-channel separation, remote sources
|
Amos Lapidoth
|
ETZ E9
|
|
21.12.2011
|
Slepian-Wolf distributed source coding
|
Amos Lapidoth
|
ETZ E9
|
