Information Theory - (6 cfu)

Prof. Alberto Bononi Tel. 0521.90.5760 - Fax. 0521.90.5758
  E-mail. bononi@tlc.unipr.it
  Home page. http://www.tlc.unipr.it/bononi/


Finalità

The course aims to present the main results of information theory, with a rigorous approach and in the perspective of signal transmission, processing and storage.

Programma

Entropy and mutual information of discrete random variables. Typical sets and sequences. Entropy rate of stochastic processes. Data compression. Huffman and universal codes. Capacity of a discrete communication channel. Differential entropy of continuous random variables. Capacity of a gaussian communication channel. Rate distortion theory. Network information theory.

Modalità d'esame

For those who attend the course: overall evaluation based on homework and oral examination.
For anyone: evaluation based on oral examination.

Propedeuticità

None.

Testi consigliati

T. M. Cover, J. A. Thomas, Elements of Information Theory, John Wiley and Sons, 1991.


Ultimo aggiornamento: 05-10-2011


Chiudi la finestra