Approximate Bayesian Inference with the Weighted Likelihood Bootstrap

作者: Michael A. Newton , Adrian E. Raftery

DOI: 10.1111/J.2517-6161.1994.TB01956.X

关键词: Bayesian inferenceStatisticsBayes factorResamplingMarginal likelihoodApplied mathematicsEstimatorMathematicsIteratively reweighted least squaresPosterior probabilityWeightingStatistics and Probability

摘要: We introduce the weighted likelihood bootstrap (WLB) as a way to simulate approximately from posterior distribution. This method is often easy implement, requiring only an algorithm for calculating maximum estimator, such iteratively reweighted least squares. In generic weighting scheme, WLB first order correct under quite general conditions. Inaccuracies can be removed by using source of samples in sampling-importance resampling (SIR) algorithm, which also allows incorporation particular prior information. The SIR-adjusted competitive alternative other integration methods certain models. Asymptotic expansions elucidate second-order properties WLB, generalization Rubin's Bayesian bootstrap. calculation approximate Bayes factors model comparison considered. note that, given sample simulated distribution, required marginal may simulation consistently estimated harmonic mean associated values; modification this estimator that avoids instability noted. These provide simple ways and probabilities very wide class

参考文章(65)
W. R. Gilks, D. G. Clayton, D. J. Spiegelhalter, N. G. Best, A. J. McNeil, L. D. Sharples, A. J. Kirby, Modelling Complexity: Applications of Gibbs Sampling in Medicine Journal of the royal statistical society series b-methodological. ,vol. 55, pp. 39- 52 ,(1993) , 10.1111/J.2517-6161.1993.TB01468.X
D. J. Spiegelhalter, A. F. M. Smith, Bayes Factors for Linear and Log-Linear Models with Vague Prior Information Journal of the royal statistical society series b-methodological. ,vol. 44, pp. 377- 387 ,(1982) , 10.1111/J.2517-6161.1982.TB01217.X
W. R. Gilks, A. Thomas, D. J. Spiegelhalter, A Language and Program for Complex Bayesian Modelling The Statistician. ,vol. 43, pp. 169- 177 ,(1994) , 10.2307/2348941
Adrian E. Raftery, Analysis of a Simple Debugging Model. Applied statistics. ,vol. 37, pp. 12- 22 ,(1988) , 10.2307/2347490
Adrian E. Raftery, Jeffrey D. Banfield, Stopping the Gibbs Sampler,the Use of Morphology,and Other Issues in Spatial Statistics (Bayesian image restoration,with two applications in spatial statistics) -- (Discussion) Annals of the Institute of Statistical Mathematics. ,vol. 43, pp. 32- 43 ,(1991)
E. Haeusler, D.M. Mason, Newton, Weighted bootstrapping of means CWI quarterly. ,vol. 4, pp. 213- 228 ,(1991)
Douglas Bates, Christian Ritter, Soeren Bisgaard, A Comparison of Approaches to Inference for Nonlinear Models ,(1992)
A. E. Gelfand, D. K. Dey, Bayesian Model Choice: Asymptotics and Exact Calculations Journal of the Royal Statistical Society: Series B (Methodological). ,vol. 56, pp. 501- 514 ,(1994) , 10.1111/J.2517-6161.1994.TB01996.X