ECE 729 Theory of Information Processing and Transmission

Instructor:     John A. Gubner, Associate Professor, ECE Department.
                Office: 3615 Engr. Hall.
                Phone: 263-1471.
                E-mail: gubner@engr.wisc.edu

Credits:        3

Prerequisites:  ECE 331 or Math 431 or consent of instructor.
                Math 521 is recommended.

Class Meets:    TR 9:30-10:45 in 3418 Engr. Hall.

Goals & Topics:

  This course provides an introduction to the probabilistic treatment
  of information theory.  The focus will be on quantifying the asymptotic
  performance limits of data compression and transmission systems.
  By comparing such limits to the performance of an actual system, one
  can estimate how much system improvement is theoretically possible.
  Topics concerning data compression include Huffman coding, Shannon's
  Source Coding Theorem, quantization and the Lloyd-Max Algorithm, rate-
  distortion theory, and the Lempel-Ziv algorithm.
  We will also study the capacity of the discrete memoryless
  channel, the Gaussian channel, the multiple-access channel, and the
  arbitrarily varying channel.

Textbooks:      None required.  Class notes will be distributed.
                Several texts will be on reserve in the library.

Computer Usage: Some homework assignments may require MATLAB.

Papers:         None.

Projects:       None.

Grading Policy: Homework 10%
                Exam 1   40%
                Exam 2   50%