Performance Analysis of Iterative Decoding Algorithms with Memory over Memoryless Channels

• Published in: IEEE transactions on communications Vol. 60; no. 12; pp. 3556 - 3566
• Main Authors: Janulewicz, E., Banihashemi, A. H.
• Format: Journal Article
• Language: English
• Published: New York, NY IEEE 01.12.2012; Institute of Electrical and Electronics Engineers; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithm design and analysis; Algorithms; Applied sciences; Back propagation; Bayesian methods; Bayesian networks; belief propagation (BP); Channels; Codes; Coding, codes; Decoding; Density; density evolution; differential decoding with binary message passing (DD-BMP); Evolution; Exact sciences and technology; Information, signal and communications theory; Iterative algorithms; Iterative coding schemes; Iterative decoding; iterative decoding algorithms with memory; Iterative methods; low-density parity-check (LDPC) codes; memoryless channels; min-sum (MS); Random variables; Signal and communications theory; Studies; Telecommunications and information theory; Performance evaluation; Markov process; belief propagation (BP); Iterative method; Iterative decoding; Implementation; Relaxation; Credal approach; low-density parity-check (LDPC) codes; Coding; min-sum (MS); iterative decoding algorithms with memory; Bayes network; Parity check codes; differential decoding with binary message passing (DD-BMP); Iterative coding schemes; Bayes estimation; density evolution; Tanner graph; memoryless channels; Algorithm; Memoryless channel; Message passing; Algorithm performance; Error correcting code; Bayesian networks
• ISSN: 0090-6778; 1558-0857
• DOI: 10.1109/TCOMM.2012.082812.110838

Density evolution is often used to determine the performance of an ensemble of low-density parity-check (LDPC) codes under iterative message-passing algorithms. Conventional density evolution techniques over memoryless channels are based on the assumption that messages at iteration ℓ are only a function of the messages at iteration ℓ -1 and possibly the channel output. This assumption is valid for many algorithms such as standard belief propagation (BP) and min-sum (MS) algorithms. However, there are other important iterative algorithms such as successive relaxation (SR) versions of BP and MS, and differential decoding with binary message passing (DD-BMP) algorithm of Mobini et al., for which this assumption is not valid. The reason is the introduction of memory in these algorithms. In this work, we propose a model for iterative decoding algorithms with memory which covers SR and DD-BMP algorithms as special cases. Based on this model, we derive a Bayesian network for iterative algorithms with memory over memoryless channels and use this representation to analyze the performance of the algorithms using density evolution. The density evolution technique is developed based on truncating the memory of the decoding process and approximating it with a finite order Markov process, and can be implemented efficiently. As an example, we apply our technique to analyze the performance of DD-BMP on regular LDPC code ensembles, and make a number of interesting observations with regard to the performance/complexity tradeoff of DD-BMP in comparison with BP and MS algorithms. The model presented in this paper is based on certain simplifying assumptions about the memory structure of iterative algorithms such as the existence of memory only at the output of variable nodes in the code's Tanner graph rather than at both outputs of variable and check nodes. The Bayesian network framework introduced here however, can still be used to analyze the more general scenarios.