RATES OF CONVERGENCE FOR THE GAUSSIAN MIXTURE SIEVE

作者: Larry Wasserman , Christopher R. Genovese

DOI: 10.1214/AOS/1015956709

关键词:

摘要: Gaussian mixtures provide a convenient method of densityestimation that lies somewhere between parametric models and kernel densityestimators. When the number components mixture is allowed to increase as sample size increases, model called sieve. We establish bound on rate convergence in Hellinger distance for using sieve assuming true density itself Gaussians; underlying mixing measure densityis not necessarilyassumed have finite support. Computing involves some delicate calculations since sieve—as measured bybracketing entropy—and saturation rate, cannot be found standard methods. has compact support, kn ∼ n 2/3 /� log n� 1/3 yields order � 1+η� /6/n1/6 every η> 0� The rates depend heavilyon tail behavior density. sensitivity diminished byusing robust which includes long-tailed component

参考文章(15)
Bruce G. Lindsay, Mixture models : theory, geometry, and applications Institute of Mathematical Statistics , American Statistical Association. ,(1995) , 10.1214/CBMS/1462106013
Aad W. van der Vaart, Subhashis Ghosal, Rates of convergence for Bayes and maximum likelihood estimation for mixture of normal densities Annals of Statistics. ,vol. 29, pp. 1233- 1263 ,(2001) , 10.1214/AOS/1013203452
Geoffrey J. McLachlan, Kaye E. Basford, Mixture models : inference and applications to clustering Statistics: Textbooks and Monographs. ,vol. 84, ,(1988)
Sara Van De Geer, Rates of convergence for the maximum likelihood estimator in mixture models Journal of Nonparametric Statistics. ,vol. 6, pp. 293- 310 ,(1996) , 10.1080/10485259608832677
Wing Hung Wong, Xiaotong Shen, Probability inequalities for likelihood ratios and convergence rates of sieve MLEs Annals of Statistics. ,vol. 23, pp. 339- 362 ,(1995) , 10.1214/AOS/1176324524
Aad W. van der Vaart, Jon A. Wellner, Weak Convergence and Empirical Processes Journal of the American Statistical Association. ,vol. 92, pp. 794- ,(1996) , 10.1007/978-1-4757-2545-2
Stuart Geman, Chii-Ruey Hwang, Nonparametric Maximum Likelihood Estimation by the Method of Sieves Annals of Statistics. ,vol. 10, pp. 401- 414 ,(1982) , 10.1214/AOS/1176345782
Peter Hall, On Kullback-Leibler loss and density estimation Annals of Statistics. ,vol. 15, pp. 1491- 1519 ,(1987) , 10.1214/AOS/1176350606
Jeffrey D. Banfield, Adrian E. Raftery, Model-based Gaussian and non-Gaussian clustering Biometrics. ,vol. 49, pp. 803- 821 ,(1993) , 10.2307/2532201
Kathryn Roeder, Semiparametric Estimation of Normal Mixture Densities Annals of Statistics. ,vol. 20, pp. 929- 943 ,(1992) , 10.1214/AOS/1176348664