SIMG-714 Information Theory

Spring 1998-99

The course develops a basic understanding of the efficient representation of information for storage and transmission. Classical concepts of information theory are developed and applied to image compression, storage and transmission. The intent is to develop a foundation for the efficient handling of image-based information in imaging systems.

1. Introduction and Overview
2. Efficient representation of discrete symbol sequences
3. Information as uncertainty reduction
4. Mutual information
5. Capacity of discrete constant information channels
6. The effects of noise and what to do about it
7. Shannon's channel coding theorem
8. Linear block codes
9. Digitization of images
10. Lossless compression
11. Lossy compression