Adaptive estimation of high-dimensional signal-to-noise ratios

作者: Nicolas Verzelen , Elisabeth Gassiat

DOI: 10.3150/17-BEJ975

关键词:

摘要: We consider the equivalent problems of estimating residual variance, proportion explained variance $\eta$ and signal strength in a high-dimensional linear regression model with Gaussian random design. Our aim is to understand impact not knowing sparsity vector coefficients distribution design on minimax estimation rates $\eta$. Depending $k$ coefficients, optimal estimators either rely or are based $U$-type statistics. In important situation where unknown, we build an adaptive procedure whose convergence rate simultaneously achieves risk over all up logarithmic loss which prove be non avoidable. Finally, knowledge shown play critical role. When consistent indeed possible much narrower regimes than for known distribution.

参考文章(35)
P. Massart, B. Laurent, Adaptive estimation of a quadratic functional by model selection Annals of Statistics. ,vol. 28, pp. 1302- 1338 ,(2000) , 10.1214/AOS/1015957395
Kenneth R. Davidson, Stanislaw J. Szarek, Chapter 8 - Local Operator Theory, Random Matrices and Banach Spaces Handbook of the Geometry of Banach Spaces. ,vol. 1, pp. 317- 366 ,(2001) , 10.1016/S1874-5849(01)80010-3
Yannick Baraud, Non-asymptotic minimax rates of testing in signal detection Bernoulli. ,vol. 8, pp. 577- 606 ,(2002)
T. Tony Cai, Zijian Guo, Confidence intervals for high-dimensional linear regression: Minimax rates and adaptivity Annals of Statistics. ,vol. 45, pp. 615- 646 ,(2017) , 10.1214/16-AOS1461
Anna Bonnet, Elisabeth Gassiat, Céline Lévy-Leduc, Heritability estimation in high dimensional sparse linear mixed models Electronic Journal of Statistics. ,vol. 9, pp. 2099- 2129 ,(2015) , 10.1214/15-EJS1069
A. B. Tsybakov, Pointwise and sup-norm sharp adaptive estimation of functions on the Sobolev classes Annals of Statistics. ,vol. 26, pp. 2420- 2469 ,(1998) , 10.1214/AOS/1024691478
David B. Goldstein, Common Genetic Variation and Human Traits The New England Journal of Medicine. ,vol. 360, pp. 1696- 1698 ,(2009) , 10.1056/NEJMP0806284
Tony Cai, Weidong Liu, Xi Luo, A Constrained ℓ1 Minimization Approach to Sparse Precision Matrix Estimation Journal of the American Statistical Association. ,vol. 106, pp. 594- 607 ,(2011) , 10.1198/JASA.2011.TM10155
T. Tony Cai, Mark G. Low, Nonquadratic estimators of a quadratic functional Annals of Statistics. ,vol. 33, pp. 2930- 2956 ,(2005) , 10.1214/009053605000000147
Radosław Adamczak, Paweł Wolff, Concentration inequalities for non-Lipschitz functions with bounded derivatives of higher order Probability Theory and Related Fields. ,vol. 162, pp. 531- 586 ,(2015) , 10.1007/S00440-014-0579-3