Course Content
Mutual information, entropy for discrete ensembles; Shannon`s noiseless coding theorem; Encoding of discrete sources. Markov sources; Shannon`s noisy coding theorem and converse for discrete channels; Calculation of channel capacity and bounds for discrete channels; Application to continuous channels.Techniques of coding and decoding; Huffman codes and uniquely detectable codes; Cyclic codes, convolutional arithmetic codes.
Text / References
- 1 N. Abramson, Information and Coding, McGraw Hill, 1963.M. Mansurpur, Introduction to Information Theory, McGraw Hill, 1987.R.B. Ash, Information Theory, Prentice Hall, 1970.Shu Lin and D.J. Costello Jr., Error Control Coding, Prentice Hall, 1983.