Course
PostgraduateSemester
ElectivesSubject Code
AVD879Subject Title
Information Theory and CodingSyllabus
Information theory: Information – Entropy, Information rate, classification of codes, Kraft McMillanin equality, Source coding theorem, Shannon ‐ Fano coding, Huffman coding, Extended Huffman coding ‐ Joint and conditional entropies, Mutual information ‐ Discrete memory less channels – BSC, BEC – Channel capacity, Shannon limit. Channel Capacity- AWGN channel, colored noise channel, Wireless Channel-SIMO MISO, MIMO channel, Error control coding –Block codes Definitions and Principles: Hamming weight, Hamming distance, Minimum distance decoding ‐ Single parity codes, Hamming codes, Repetition codes‐Linear block codes, Cyclic codes‐Syndrome calculation, Encoder and decoder, BCH codes, CRC codes, RS codes, Decoding Techniques for RS codes, LDPC encoder and decoder, Performance analysis of RS and LDPC codes. Polar Codes: polar encoder and decoder, performance analysis of polar codes – Convolution codes: Linear convolution encoders, Structural properties of Convolution codes, Viterbi decoding technique for convolution codes – Soft / Hard decision, concatenation of block codes and convolutional codes, performance analysis, concept of Trellis coded modulation. Turbo Codes: Parallel concatenation, Turbo encoder, Iterative decoding using BCJR algorithm, Performance analysis.
Text Books
Same as Reference
References
1. Information Theory and Coding, Norman Abramson, McGraw-Hill,1963.
2. Digital Communications, John Proakis & Masoud Salehi, 5th edition, McGraw-Hill, 2008.
3. Introduction to Error Control Codes, S Gravano, Oxford University Press, 2007.
4. The theory of Information theory and coding, Robert Mc Eliece, Cambridge University Press, 2002
5. Error Control Coding: Fundamentals and applications, Shu Lin and Daniel.J. Costello Jr.,Prentice Hall Inc.
6. Theory and Practice of Error Control Coding, R.E. Blahut, MGH.
7. Fundamentals of Error-correcting codes, W.C.Huffman and Vera Pless, , Cambridge University Press.
8. Fundamentals of Convolution Coding, Rolf Johannesson, KamilSh. Zigangirov, Universities Press, India.
9. Digital Communication, Sklar, Pearson Education
Course Outcomes (COs):
CO1: Understand the theoretical bounds and the limitation of communication system
CO2: Design lossless and lossy source coding techniques
CO3: Ability to design a channel coding scheme for the specific error correction capability of the communication system