Predictive stochastic complexity and model estimation for finite-state processes

作者: Marcelo J. Weinberger , Meir Feder

DOI: 10.1016/0378-3758(94)90092-2

关键词:

摘要: Abstract It is shown that the predictive and nonpredictive stochastic complexities relative to class of finite-state models are asymptotically equivalent in a probabilistic sense. To this end, universal, sequential, noiseless coding scheme attaining minimum description length (MDL) data with respect presented investigated. relies on an MDL-based estimator model structure, which proved be strongly consistent. An interpretation result process ‘close’ every class, regardless can constructed. This universal employed solution sequential decision problems like coding, prediction, gambling, optimal manner.

参考文章(25)
E. J. Hannan, B. G. Quinn, The Determination of the Order of an Autoregression Journal of the Royal Statistical Society: Series B (Methodological). ,vol. 41, pp. 190- 195 ,(1979) , 10.1111/J.2517-6161.1979.TB01072.X
Jorma Rissanen, Stochastic Complexity and Modeling Annals of Statistics. ,vol. 14, pp. 1080- 1100 ,(1986) , 10.1214/AOS/1176350051
David Blackwell, Lambert Koopmans, On the Identifiability Problem for Functions of Finite Markov Chains Annals of Mathematical Statistics. ,vol. 28, pp. 1011- 1015 ,(1957) , 10.1214/AOMS/1177706802
R. Krichevsky, V. Trofimov, The performance of universal encoding IEEE Transactions on Information Theory. ,vol. 27, pp. 199- 207 ,(1981) , 10.1109/TIT.1981.1056331
A. N. Kolmogorov, Three approaches to the quantitative definition of information International Journal of Computer Mathematics. ,vol. 2, pp. 157- 168 ,(1968) , 10.1080/00207166808803030
P. WHITTLE, TESTS OF FIT IN TIME SERIES Biometrika. ,vol. 39, pp. 309- 318 ,(1952) , 10.1093/BIOMET/39.3-4.309
L. Davisson, Minimax noiseless universal coding for Markov sources IEEE Transactions on Information Theory. ,vol. 29, pp. 211- 215 ,(1983) , 10.1109/TIT.1983.1056652
M. Feder, Gambling using a finite state machine IEEE Transactions on Information Theory. ,vol. 37, pp. 1459- 1465 ,(1991) , 10.1109/18.133269
Steven Rudich, Inferring the structure of a Markov Chain from its output 26th Annual Symposium on Foundations of Computer Science (sfcs 1985). pp. 321- 326 ,(1985) , 10.1109/SFCS.1985.34
M.J. Weinberger, J.J. Rissanen, M. Feder, A universal finite memory source IEEE Transactions on Information Theory. ,vol. 41, pp. 643- 652 ,(1995) , 10.1109/18.382011