ECE 729 Theory of Information Processing and Transmission, Spring 2001


Instructor:     John A. Gubner, Associate Professor, ECE Department.
                Office: 3615 Engr. Hall.
                Phone: 263-1471.
                E-mail: gubner@engr.wisc.edu
                Homepage: http://www.cae.wisc.edu/~gubner/

Credits:        3

Prerequisites:  ECE 331 or Math 431 or consent of instructor.
                Math 521 is recommended.

Class Meets:    MWF 1:20-2:10 in 3444 Engr. Hall.

Goals & Topics:

  This course provides an introduction to the probabilistic treatment
  of information theory.  The focus will be on quantifying the asymptotic
  performance limits of data compression and transmission systems.
  By comparing such limits to the performance of an actual system, one
  can estimate how much system improvement is theoretically possible.
  Topics concerning data compression include Huffman coding, Shannon's
  Source Coding Theorem, quantization and the Lloyd-Max Algorithm, rate-
  distortion theory, and the Lempel-Ziv algorithm.
  We will also study the capacity of the discrete memoryless
  channel, and the Gaussian channel.

Textbooks:      Course Notes at Bob's Copy Shop.
                

Computer Usage: Some homework assignments may require MATLAB.

Papers:         None.

Projects:       None.

Grading Policy: Homework 10%
                Exam 1   40%
                Exam 2   50%