Model selection in density estimation via cross-validation

作者: Alain Celisse

DOI:

关键词: Test setDensity estimationBounded functionProjection (set theory)EstimatorMathematical optimizationCardinalityModel selectionCross-validationMathematics

摘要: The problem of model selection by cross-validation is addressed in the density estimation framework. Extensively used practice, (CV) remains poorly understood, especially non-asymptotic setting which main concern this work. A recurrent with CV computation time it involves. This drawback overcome here thanks to closed-form expressions for estimator risk a broad class widespread estimators: projection estimators. In order shed new lights on procedures respect cardinality $p$ test set, interpreted as penalized criterion random penalty. For instance, amount penalization shown increase $p$. theoretical assessment performance carried out two oracle inequalities applying respectively bounded or square-integrable densities. several collections models, adaptivity results Holder and Besov spaces are derived well.

参考文章(43)
M. Stone, An Asymptotic Equivalence of Choice of Model by Cross-Validation and Akaike's Criterion Journal of the Royal Statistical Society: Series B (Methodological). ,vol. 39, pp. 44- 47 ,(1977) , 10.1111/J.2517-6161.1977.TB01603.X
Lucien Birgé, Pascal Massart, From Model Selection to Adaptive Estimation Festschrift for Lucien Le Cam. pp. 55- 87 ,(1997) , 10.1007/978-1-4612-1880-7_4
Cohn L. Mallows, More Comments onCp Technometrics. ,vol. 37, pp. 362- 372 ,(1995) , 10.1080/00401706.1995.10484370
R. Z. Khasʹminskiĭ, I. A. Ibragimov, Statistical estimation : asymptotic theory Springer-Verlag. ,(1981)
Alain Celisse, A leave-p-out based estimation of the proportion of null hypotheses arXiv: Statistics Theory. ,(2008)
Gilles Blanchard, Pascal Massart, Discussion: Local Rademacher complexities and oracle inequalities in risk minimization Annals of Statistics. ,vol. 34, pp. 2664- 2671 ,(2006) , 10.1214/009053606000001037
Evarist Gine, Lectures on some aspects of the bootstrap Lecture Notes in Mathematics. pp. 37- 151 ,(1997) , 10.1007/BFB0092619