Modified versions of the Bayesian Information Criterion for sparse Generalized Linear Models

作者: Małgorzata Bogdan , Małgorzata Żak-Szatkowska

DOI: 10.1016/J.CSDA.2011.04.016

关键词:

摘要: Abstract The classical model selection criteria, such as the Bayesian Information Criterion (BIC) or Akaike information criterion (AIC), have a strong tendency to overestimate number of regressors when search is performed over large potential explanatory variables. To handle problem overestimation, several modifications BIC been proposed. These versions rely on supplementing original with some prior distributions class possible models. Three are presented and compared in context sparse Generalized Linear Models (GLMs). related choices priors discussed conditions for asymptotic equivalence these criteria provided. performance modified illustrated an extensive simulation study real data analysis. Also, simplified BIC, based least squares regression, investigated.

参考文章(44)
Florian Frommlet, Malgorzata Bogdan, Arijit Chakrabarti, Asymptotic Bayes optimality under sparsity of selection rules for general priors ,(2010)
J. K. Ghosh, Tapas Samanta, Mohan Delampady, An Introduction to Bayesian Analysis: Theory and Methods ,(2006)
Peter McCullagh, John Ashworth Nelder, Generalized Linear Models ,(1983)
Gui-Bo Ye, Xiaohui Xie, Split Bregman method for large scale fused Lasso Computational Statistics & Data Analysis. ,vol. 55, pp. 1552- 1569 ,(2011) , 10.1016/J.CSDA.2010.10.021
Douglas M. Potter, A permutation test for inference in logistic regression with small- and moderate-sized data sets. Statistics in Medicine. ,vol. 24, pp. 693- 708 ,(2005) , 10.1002/SIM.1931
A. ALBERT, J. A. ANDERSON, On the existence of maximum likelihood estimates in logistic regression models Biometrika. ,vol. 71, pp. 1- 10 ,(1984) , 10.1093/BIOMET/71.1.1
David Donoho, Jiashun Jin, Higher criticism for detecting sparse heterogeneous mixtures Annals of Statistics. ,vol. 32, pp. 962- 994 ,(2004) , 10.1214/009053604000000265
Florian Frommlet, Felix Ruhaltinger, Piotr Twaróg, Małgorzata Bogdan, Modified versions of Bayesian Information Criterion for genome-wide association studies Computational Statistics & Data Analysis. ,vol. 56, pp. 1038- 1051 ,(2012) , 10.1016/J.CSDA.2011.05.005
David E. Hapeman, Categorical Data Analysis Technometrics. ,vol. 33, pp. 241- 241 ,(1991) , 10.1080/00401706.1991.10484817