Information Theory – 046733
Prerequisites: Introduction to Digital Communication 046206
Identical Courses: Information Theory 048733
Topics: Modeling of sources, channels and communication systems. Performance measures. Lossless source coding. Information measures. Data processing theorem. The method of types. Rate distortion function for finite and continuous alphabets. Channel capacity and the channel coding theorem. Joint source-channel coding and the separation theorem.