MEASURING OVERFITTING IN NONLINEAR MODELS: A NEW METHOD AND AN APPLICATION TO HEALTH EXPENDITURES

作者: Marcel Bilger , Willard G. Manning

DOI: 10.1002/HEC.3003

关键词: Scale (ratio)OverfittingInferenceRegression analysisStatisticsNonlinear systemMeasure (mathematics)Econometric modelCross-validationComputer scienceEconometrics

摘要: When fitting an econometric model, it is well known that we pick up part of the idiosyncratic characteristics data along with systematic relationship between dependent and explanatory variables. This phenomenon as overfitting generally occurs when a model excessively complex relative to amount available. Overfitting major threat regression analysis in terms both inference prediction. We start by showing Copas measure becomes confounded shrinkage or expansion arising from in-sample bias applied untransformed scale nonlinear models, which typically interest assessing behaviors analyzing policies. then propose new expressed on immune this problem. also show how respective contributions overall predictive applying estimated data. finally illustrate properties our through simulation study real-data illustration based inpatient healthcare expenditure data, shows distinctions can be important.

参考文章(23)
J. B. Copas, Regression, Prediction and Shrinkage Journal of the royal statistical society series b-methodological. ,vol. 45, pp. 311- 335 ,(1983) , 10.1111/J.2517-6161.1983.TB01258.X
S. C. Larson, The shrinkage of the coefficient of multiple correlation. Journal of Educational Psychology. ,vol. 22, pp. 45- 55 ,(1931) , 10.1037/H0072400
Seymour Geisser, The Predictive Sample Reuse Method with Applications Journal of the American Statistical Association. ,vol. 70, pp. 320- 328 ,(1975) , 10.1080/01621459.1975.10479865
J. C. Van Houwelingen, S. Le Cessie, Predictive value of statistical models Statistics in Medicine. ,vol. 9, pp. 1303- 1325 ,(1990) , 10.1002/SIM.4780091109
George E P Box, Norman R Draper, Empirical Model-Building and Response Surfaces ,(1987)
David Meltzer, Willard G Manning, Jeanette Morrison, Manish N Shah, Lei Jin, Todd Guth, Wendy Levinson, Effects of Physician Experience on Costs and Outcomes on an Academic General Medicine Service: Results of a Trial of Hospitalists Annals of Internal Medicine. ,vol. 137, pp. 866- 874 ,(2002) , 10.7326/0003-4819-137-11-200212030-00007
Willard G. Manning, The logged dependent variable, heteroscedasticity, and the retransformation problem Journal of Health Economics. ,vol. 17, pp. 283- 295 ,(1998) , 10.1016/S0167-6296(98)00025-3
R. J. Wherry, A New Formula for Predicting the Shrinkage of the Coefficient of Multiple Correlation Annals of Mathematical Statistics. ,vol. 2, pp. 440- 457 ,(1931) , 10.1214/AOMS/1177732951
Peter J. Veazie, Willard G. Manning, Robert L. Kane, Improving risk adjustment for Medicare capitated reimbursement using nonlinear models. Medical Care. ,vol. 41, pp. 741- 752 ,(2003) , 10.1097/01.MLR.0000065127.88685.7D