On zero-error source coding with decoder side information

• Published in: IEEE transactions on information theory Vol. 49; no. 1; pp. 99 - 111
• Main Authors: Koulgi, P., Tuncel, E., Regunathan, S.L., Rose, K.
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.01.2003; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithm design and analysis; Codes; Decoding; Entropy; Information theory; Materials science and technology; Mathematical models; Polynomials; Probability distribution; Random variables; Source coding
• ISSN: 0018-9448; 1557-9654
• DOI: 10.1109/TIT.2002.806154

Let (X,Y) be a pair of random variables distributed over a finite product set V/spl times/W according to a probability distribution P(x,y). The following source coding problem is considered: the encoder knows X, while the decoder knows Y and wants to learn X without error. The minimum zero-error asymptotic rate of transmission is shown to be the complementary graph entropy of an associated graph. Thus, previous results in the literature provide upper and lower bounds for this minimum rate (further, these bounds are tight for the important class of perfect graphs). The algorithmic aspects of instantaneous code design are considered next. It is shown that optimal code design is NP-hard. An optimal code design algorithm is derived. Polynomial-time suboptimal algorithms are also presented, and their average and worst case performance guarantees are established.