Use of the Bootstrap and Cross-Validation in Ridge Regression

作者: Nancy Jo Delaney , Sangit Chatterjee

DOI: 10.1080/07350015.1986.10509520

关键词: Condition numberBootstrap aggregatingStandard errorCross-validationStatisticsMathematicsMonte Carlo methodCollinearityMean squared errorDesign matrix

摘要: Several existing methods for the choice of ridge parameter are reviewed, and a bootstrap method is proposed. The provides independent measures prediction errors based on multiple predictions along with an estimate standard error prediction. selected competitors compared through Monte Carlo simulations various degrees design matrix collinearity varying levels signal-to-noise ratio. procedure also illustrated by application to two published data sets. In one case, leads smaller mean squared than trace method. second optimal no perturbation confirmed. Benefits include its less subjective nature, ease implementation, robustness.

参考文章(24)
Arthur E. Hoerl, Robert W. Kennard, Ridge regression iterative estimation of the biasing parameter Communications in Statistics-theory and Methods. ,vol. 5, pp. 77- 88 ,(1976) , 10.1080/03610927608827333
Gene H. Golub, Michael Heath, Grace Wahba, Generalized Cross-Validation as a Method for Choosing a Good Ridge Parameter Technometrics. ,vol. 21, pp. 215- 223 ,(1979) , 10.1080/00401706.1979.10489751
Dean W. Wichern, Gilbert A. Churchill, A Comparison of Ridge Estimators Technometrics. ,vol. 20, pp. 301- 311 ,(1978) , 10.1080/00401706.1978.10489675
D. A. Freedman, Bootstrapping Regression Models Annals of Statistics. ,vol. 9, pp. 1218- 1228 ,(1981) , 10.1214/AOS/1176345638
Kesar Singh, On the Asymptotic Accuracy of Efron's Bootstrap Annals of Statistics. ,vol. 9, pp. 1187- 1195 ,(1981) , 10.1214/AOS/1176345636
Norman R. Draper, R. Craig Van Nostrand, Ridge Regression and James-Stein Estimation: Review and Comments Technometrics. ,vol. 21, pp. 451- 466 ,(1979) , 10.1080/00401706.1979.10489815
Jose Ferreira de Carvalho, N. R. Draper, H. Smith, Applied regression analysis 2nd ed. Journal of the American Statistical Association. ,vol. 76, pp. 1012- ,(1981) , 10.2307/2287608
Norman Richard Draper, Harry Smith, Applied Regression Analysis ,(1966)