ECE 729 Theory of Information Processing and Transmission, Spring 2006

Instructor:     John A. Gubner, Associate Professor, ECE Department.
                Office: 3615 Engr. Hall.
                Phone: 263-1471.
                E-mail: gubner@engr.wisc.edu
                Homepage: http://homepages.cae.wisc.edu/~gubner/

Credits:        3

Prerequisites:  ECE 331 or Math 431 or consent of instructor.
                Math 521 is recommended.

Class Meets:    MWF 1:20-2:10 in 3444 Engr. Hall.

Goals & Topics:

  This course provides an introduction to the probabilistic treatment
  of information theory.  The focus will be on quantifying the asymptotic
  performance limits of data compression and transmission systems.
  By comparing such limits to the performance of an actual system, one
  can estimate how much system improvement is theoretically possible.
  Topics concerning data compression include Huffman (pic, honors, obit)
  coding, Shannon's (obit) Source Coding Theorem, quantization
  and the Lloyd-Max Algorithm, rate-distortion theory, and the
  Lempel-Ziv algorithm.  We will also study the capacity of the
  discrete memoryless channel and the Gaussian channel.

Course Notes:   Required, available at Bob's Copy Shop.

Computer Usage: Some homework assignments may require MATLAB.

Papers:         None.

Projects:       Yes.

Grading Policy: Homework   10%,  No late homework accepted.
                Projects   10%
                Exam 1     40%
                Exam 2     40%