Variable Selection Via Subtle Uprooting

作者: Xiaogang Su

DOI: 10.1080/10618600.2014.955176

关键词:

摘要: This article proposes a variable selection method termed “subtle uprooting” for linear regression. In this proposal, is formulated into single optimization problem by approximating cardinality involved in the information criterion with smooth function. A technical maneuver then employed to enforce sparsity of parameter estimates while maintaining smoothness objective To solve resulting nonconvex problem, modified Broyden–Fletcher–Goldfarb–Shanno (BFGS) algorithm established global and super-linear convergence adopted. Both simulated experiments an empirical example are provided assessment illustration. Supplementary materials available online.

参考文章(28)
A. W. van der Vaart, Asymptotic Statistics Cambridge University Press. ,(1998) , 10.1017/CBO9780511802256
Rahul Mazumder, Jerome H. Friedman, Trevor Hastie, SparseNet: Coordinate Descent With Nonconvex Penalties. Journal of the American Statistical Association. ,vol. 106, pp. 1125- 1138 ,(2011) , 10.1198/JASA.2011.TM09738
Michael R. Osborne, Brett Presnell, Berwin A. Turlach, On the LASSO and Its Dual Journal of Computational and Graphical Statistics. ,vol. 9, pp. 319- 337 ,(2000) , 10.2307/1390657
B. K. Natarajan, Sparse Approximate Solutions to Linear Systems SIAM Journal on Computing. ,vol. 24, pp. 227- 234 ,(1995) , 10.1137/S0097539792240406
Fengrong Wei, Hongxiao Zhu, Group coordinate descent algorithms for nonconvex penalized regression Computational Statistics & Data Analysis. ,vol. 56, pp. 316- 326 ,(2012) , 10.1016/J.CSDA.2011.08.007
Arthur E. Hoerl, Robert W. Kennard, Ridge regression: biased estimation for nonorthogonal problems Technometrics. ,vol. 42, pp. 80- 86 ,(2000) , 10.2307/1271436
Dong C. Liu, Jorge Nocedal, On the limited memory BFGS method for large scale optimization Mathematical Programming. ,vol. 45, pp. 503- 528 ,(1989) , 10.1007/BF01589116
Robert Tibshirani, Trevor Hastie, Berwin A. Turlach, Bradley Efron, Jean Michel Loubes, Jean Michel Loubes, Hemant Ishwaran, Robert A. Stine, Keith Knight, Sanford Weisberg, Saharon Rosset, Saharon Rosset, Iain Johnstone, Pascal Massart, Pascal Massart, David Madigan, J. I. Zhu, Greg Ridgeway, Greg Ridgeway, Least angle regression Annals of Statistics. ,vol. 32, pp. 407- 499 ,(2004) , 10.1214/009053604000000067
Leo Breiman, Better subset regression using the nonnegative garrote Technometrics. ,vol. 37, pp. 373- 384 ,(1995) , 10.2307/1269730