Bayesian Adaptive Sampling for Variable Selection and Model Averaging

作者: Merlise A. Clyde , Joyee Ghosh , Michael L. Littman

DOI: 10.1198/JCGS.2010.09049

关键词: Simple random sampleLinear regressionAdaptive samplingBayesian probabilitySlice samplingMathematical optimizationMarkov chain Monte CarloFeature selectionMathematicsSampling (statistics)

摘要: For the problem of model choice in linear regression, we introduce a Bayesian adaptive sampling algorithm (BAS), that samples models without replacement from space models. problems permit enumeration all models, BAS is guaranteed to enumerate 2p iterations where p number potential variables under consideration. larger required, provide conditions which provides perfect replacement. When probabilities are marginal variable inclusion probabilities, may be viewed as “near” median probability Barbieri and Berger. As not known advance, discuss several strategies estimate adaptively within BAS. We illustrate performance using simulated real data show can outperform Markov chain Monte Carlo methods. The imple...

参考文章(19)
Robert E. McCulloch, Edward I. George, APPROACHES FOR BAYESIAN VARIABLE SELECTION Statistica Sinica. ,vol. 7, pp. 339- 373 ,(1997)
Merlise A. Clyde, J. O. Berger, J. M. Bernardo, A. P. Dawid, Bayesian Model Averaging and Model Search Strategies ,(2007)
Chris T. Volinsky, Adrian E. Raftery, David Madigan, Jennifer A. Hoeting, Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors Statistical Science. ,vol. 14, pp. 382- 417 ,(1999) , 10.1214/SS/1009212519
Merlise A. Clyde, Giovanni Parmigiani, Protein construct storage: bayesian variable selection and prediction with mixtures Journal of Biopharmaceutical Statistics. ,vol. 8, pp. 431- 443 ,(1998) , 10.1080/10543409808835251
Melanie A. Wilson, Edwin S. Iversen, Merlise A. Clyde, Scott C. Schmidler, Joellen M. Schildkraut, BAYESIAN MODEL SEARCH AND MULTILEVEL INFERENCE FOR SNP ASSOCIATION STUDIES. The Annals of Applied Statistics. ,vol. 4, pp. 1342- 1364 ,(2010) , 10.1214/09-AOAS322
D. J. Thompson, D. G. Horvitz, A generalization of sampling without replacement from a finite universe. Journal of the American Statistical Association. ,vol. 47, pp. 663- 685 ,(1952) , 10.2307/2280784
Feng Liang, Rui Paulo, German Molina, Merlise A Clyde, Jim O Berger, Mixtures of g Priors for Bayesian Variable Selection Journal of the American Statistical Association. ,vol. 103, pp. 410- 423 ,(2008) , 10.1198/016214507000001337
David J Nott, Peter J Green, Bayesian Variable Selection and the Swendsen-Wang Algorithm Journal of Computational and Graphical Statistics. ,vol. 13, pp. 141- 157 ,(2004) , 10.1198/1061860042958
Merlise Clyde, Heather Desimone, Giovanni Parmigiani, Prediction via Orthogonalized Model Mixing Journal of the American Statistical Association. ,vol. 91, pp. 1197- 1208 ,(1996) , 10.1080/01621459.1996.10476989
David J. Nott, Robert Kohn, Adaptive sampling for Bayesian variable selection Biometrika. ,vol. 92, pp. 747- 763 ,(2005) , 10.1093/BIOMET/92.4.747