Suboptimum decoding using Kullback principle

作者: Gérard Battail , Rémi Sfez

DOI: 10.1007/3-540-19402-9_61

关键词: Linear codeAlgorithmPattern recognitionMathematicsInverse-chi-squared distributionPrinciple of maximum entropyArtificial intelligenceDecoding methodsParity bitMaximum entropy probability distributionKullback–Leibler divergencePosterior probability

摘要: Several successive decodings of cascaded codes become possible in principle without information loss if the decoding task is extended to determine a posterior probability distribution on codewords. Kullback cross-entropy minimization considered as means implementing it. Its practical use, however, demands some kind simplification. We propose look for separable form with respect symbols, which leads output same its input. As an illustration these ideas, we iterated product parity-check results vanishingly small error provided channel signal-to-noise ratio larger than threshold. Interpreting single linear code parity checks, ideas lead simple and efficient algorithm.

参考文章(7)
N. Abramson, Cascade Decoding of Cyclic Product Codes IEEE Transactions on Communications. ,vol. 16, pp. 398- 402 ,(1968) , 10.1109/TCOM.1968.1089859
P. Elias, Error-free Coding Transactions of the IRE Professional Group on Information Theory. ,vol. 4, pp. 29- 37 ,(1954) , 10.1109/TIT.1954.1057464
G. Battail, M. Decouvelaere, P. Godlewski, Replication decoding IEEE Transactions on Information Theory. ,vol. 25, pp. 332- 345 ,(1979) , 10.1109/TIT.1979.1056035
Gérard Battail, Le décodage pondere en tant que procédé de réévaluation d’une distribution de probabilité Annales Des Télécommunications. ,vol. 42, pp. 499- 509 ,(1987) , 10.1007/BF02994981
J. Shore, R. Johnson, Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy IEEE Transactions on Information Theory. ,vol. 26, pp. 26- 37 ,(1980) , 10.1109/TIT.1980.1056144
R. Silverman, Martin Balser, Coding for Constant-Data-Rate Systems-Part I. A New Error-Correcting Code Proceedings of the IRE. ,vol. 42, pp. 1428- 1435 ,(1954) , 10.1109/JRPROC.1954.274577
Solomon Kullback, Information Theory and Statistics ,(1959)