Consistent order estimation and minimal penalties

作者: E. Gassiat , R. van Handel

DOI: 10.1109/TIT.2012.2221122

关键词:

摘要: Consider an i.i.d. sequence of random variables whose distribution f* lies in one a nested family models M_q, q>=1. The smallest index q* such that M_{q*} contains is called the model order. We establish strong consistency penalized likelihood order estimator general setting with penalties \eta(q) log n, where dimensional quantity. Moreover, are shown to be minimal. In contrast previous work, priori upper bound on not assumed. results rely sharp characterization pathwise fluctuations generalized ratio statistic under entropy assumptions classes. Our applied geometrically complex problem location mixture estimation, which widely used but poorly understood.

参考文章(28)
J. A. Hartigan, A failure of likelihood asymptotics for normal mixtures Proceedings of the Berkeley Conference in Honor of Jerzy Neyman and Jack Kiefer, 1985. ,vol. 2, pp. 807- 810 ,(1985)
A. W. van der Vaart, Asymptotic Statistics Cambridge University Press. ,(1998) , 10.1017/CBO9780511802256
E. J. Hannan, B. G. Quinn, The Determination of the Order of an Autoregression Journal of the Royal Statistical Society: Series B (Methodological). ,vol. 41, pp. 190- 195 ,(1979) , 10.1111/J.2517-6161.1979.TB01072.X
Lorenzo Finesso, Consistent estimation of the order for Markov and hidden Markov chains University of Maryland at College Park. ,(1992)
P. J. Bickel, Asymptotic distribution of the likelihood ratio statistic in a prototypical non regular problem Statistics and Probability : A Raghu Raj Bahadur Gestschrift. ,(1993)
Tobias Ryden, Olivier Capp, Eric Moulines, Inference in Hidden Markov Models ,(2008)
Larry Wasserman, Christopher R. Genovese, RATES OF CONVERGENCE FOR THE GAUSSIAN MIXTURE SIEVE Annals of Statistics. ,vol. 28, pp. 1105- 1127 ,(2000) , 10.1214/AOS/1015956709
Jorma Rissanen, Stochastic Complexity and Modeling Annals of Statistics. ,vol. 14, pp. 1080- 1100 ,(1986) , 10.1214/AOS/1176350051
M. Ledoux, M. Talagrand, Comparison Theorems, Random Geometry and Some Limit Theorems for Empirical Processes Annals of Probability. ,vol. 17, pp. 596- 631 ,(1989) , 10.1214/AOP/1176991418
Antoine Chambaz, Testing the order of a model Annals of Statistics. ,vol. 34, pp. 1166- 1203 ,(2006) , 10.1214/009053606000000344