Adaptive estimation of a quadratic functional by model selection

作者: P. Massart , B. Laurent

DOI: 10.1214/AOS/1015957395

关键词:

摘要: We consider the problem of estimating $\|s\|^2$ when $s$ belongs to some separable Hilbert space and one observes Gaussian process $Y(t) = \langles, t\rangle + \sigmaL(t)$, for all $t \epsilon \mathbb{H}$,where $L$ is isonormal process. This framework allows us in particular classical “Gaussian sequence model” which $\mathbb{H} l_2(\mathbb{N}*)$ $L(t) \sum_{\lambda\geq1}t_{\lambda}\varepsilon_{\lambda}$, where $(\varepsilon_{\lambda})_{\lambda\geq1}$ a i.i.d. standard normal variables. Our approach consists considering at most countable families finite-dimensional linear subspaces $\mathbb{H}$ (the models) then using model selection via conveniently penalized least squares criterion build new estimators $\|s\|^2$. prove general nonasymptotic risk bound show that such are adaptive on variety collections sets parameter $s$, depending family models from they built.In particular, context model, convenient choice defining over hyperrectangles, ellipsoids, $l_p$-bodies or Besov bodies.We take special care describe conditions under estimator efficient level noise $\sigma$ tends zero. construction an alternative by Efroimovich Low hyperrectangles provides results otherwise.

参考文章(18)
Lucien Birgé, Pascal Massart, From Model Selection to Adaptive Estimation Festschrift for Lucien Le Cam. pp. 55- 87 ,(1997) , 10.1007/978-1-4612-1880-7_4
Iain M. Johnstone, Chi-square oracle inequalities ,(2000)
Lucien Birg�, Approximation dans les espaces m�triques et th�orie de l'estimation Zeitschrift f�r Wahrscheinlichkeitstheorie und Verwandte Gebiete. ,vol. 65, pp. 181- 237 ,(1983) , 10.1007/BF00532480
Ghislaine Gayraud, Karine Tribouley, Wavelet methods to estimate an integrated quadratic functional: Adaptivity and asymptotic law Statistics & Probability Letters. ,vol. 44, pp. 109- 122 ,(1999) , 10.1016/S0167-7152(98)00296-X
Compression of wavelet decompositions American Journal of Mathematics. ,vol. 114, pp. 737- 785 ,(1992) , 10.1515/9781400827268.784
Lucien Birgé, Pascal Massart, Gaussian model selection Journal of the European Mathematical Society. ,vol. 3, pp. 203- 268 ,(2001) , 10.1007/S100970100031
David L. Donoho, Iain M. Johnstone, Minimax estimation via wavelet shrinkage Annals of Statistics. ,vol. 26, pp. 879- 921 ,(1998) , 10.1214/AOS/1024691081
Lucien Birge, Pascal Massart, Estimation of Integral Functionals of a Density Annals of Statistics. ,vol. 23, pp. 11- 29 ,(1995) , 10.1214/AOS/1176324452
Yannick Baraud, Model selection for regression on a fixed design Probability Theory and Related Fields. ,vol. 117, pp. 467- 493 ,(2000) , 10.1007/PL00008731
David L Donoho, Michael Nussbaum, Minimax quadratic estimation of a quadratic functional Journal of Complexity. ,vol. 6, pp. 290- 323 ,(1990) , 10.1016/0885-064X(90)90025-9