Information Theory - (6 cfu)

Prof. Alberto Bononi Tel. 0521.90.5760 - Fax. 0521.90.5758
  Home page.


The course aims to present the main results of information theory, with a rigorous approach and in the perspective of signal transmission, processing and storage.


Entropy and mutual information of discrete random variables. Typical sets and sequences. Entropy rate of stochastic processes. Data compression. Huffman and universal codes. Capacity of a discrete communication channel. Differential entropy of continuous random variables. Capacity of a gaussian communication channel. Rate distortion theory. Network information theory.

Modalità d'esame

For those who attend the course: overall evaluation based on homework and oral examination.
For anyone: evaluation based on oral examination.



Testi consigliati

T. M. Cover, J. A. Thomas, Elements of Information Theory, John Wiley and Sons, 1991.

Ultimo aggiornamento: 05-10-2011

Chiudi la finestra