Strongly consistent code-based identification and order estimation for constrained finite-state model classes

作者: J.C. Kieffer

DOI: 10.1109/18.256497

关键词:

摘要: Observations are made of data generated by a stationary ergodic finite-alphabet information source according to an unknown statistical model. Two modeling problems, the identification problem and order estimation problem, considered. It is required that given model class in each be constrained finite-state class, which type includes many classes information-theoretic interest. Strongly consistent decision rules exhibited both problem. The code-based chosen based on how well certain code for encodes observed data. used maximum likelihood asymptotic performance gauged means key property divergence-rate distance. >

参考文章(19)
J. F. C. Kingman, The Ergodic Theory of Subadditive Stochastic Processes Journal of the Royal Statistical Society: Series B (Methodological). ,vol. 30, pp. 499- 510 ,(1968) , 10.1111/J.2517-6161.1968.TB00749.X
Robert M. Gray, Entropy and information theory ,(1990)
Robert M. Gray, J. C. Kieffer, Asymptotically Mean Stationary Measures Annals of Probability. ,vol. 8, pp. 962- 973 ,(1980) , 10.1214/AOP/1176994624
Jorma Rissanen, Stochastic Complexity and Modeling Annals of Statistics. ,vol. 14, pp. 1080- 1100 ,(1986) , 10.1214/AOS/1176350051
H. Tong, Determination of the order of a Markov chain by Akaike's information criterion Journal of Applied Probability. ,vol. 12, pp. 488- 497 ,(1975) , 10.2307/3212863
L.C. Zhao, P.R. Krishnaiah, Z.D. Bai, On detection of the number of signals in presence of white noise Journal of Multivariate Analysis. ,vol. 20, pp. 1- 25 ,(1986) , 10.1016/0047-259X(86)90017-5
Jorma Rissanen, Stochastic complexity and the mdl principle Econometric Reviews. ,vol. 6, pp. 85- 102 ,(1987) , 10.1080/07474938708800126
J.C. Kieffer, Sample converses in source coding theory IEEE Transactions on Information Theory. ,vol. 37, pp. 263- 268 ,(1991) , 10.1109/18.75241
John C. Kieffer, Estimation of a Convex Real Parameter of an Unknown Information Source Annals of Probability. ,vol. 7, pp. 882- 886 ,(1979) , 10.1214/AOP/1176994948
J. Rissanen, Paper: Modeling by shortest data description Automatica. ,vol. 14, pp. 465- 471 ,(1978) , 10.1016/0005-1098(78)90005-5