On the association between a random parameter and an observable

作者: Angelika van der Linde

DOI: 10.1007/BF02603002

关键词:

摘要: The association between an observable and a random parameter characterizes their joint distribution given the marginal distributions. It has been shown to be incorporated in (log-)odds ratio function. is inherent each of conditional distributions hence determines learning process formalized Bayes' theorem. paper focuses on two applications. Commonly used measures dependence, especially Kullback-Leibler distances densities interest are identified interpreted as expected values log-odds Frequently Bayesian inference based maximization utility. If utility probability density defined by logarithmic score function, can often decomposed approximately into term ``fit'' ``model complexity''. parameterization reveals that complexity'' again value i.e., measure dependence parameter. ideas illustrated throughout with examples from class conjugate exponential families.

参考文章(13)
E. Gutiérrez-Peña, A. F. M. Smith, José M. Bernardo, Guido Consonni, Piero Veronese, E. I. George, F. J. Girón, M. L. Martínez, G. Letac, Carl N. Morris, Exponential and bayesian conjugate families: Review and extensions Test. ,vol. 6, pp. 1- 90 ,(1997) , 10.1007/BF02564426
Surekha Mudivarthy, M Bhaskara Rao, Model Selection and Inference Technometrics. ,vol. 42, pp. 319- 319 ,(2000) , 10.1080/00401706.2000.10486070
Jianming Ye, On Measuring and Correcting the Effects of Data Mining and Model Selection Journal of the American Statistical Association. ,vol. 93, pp. 120- 131 ,(1998) , 10.1080/01621459.1998.10474094
M. H. DeGroot, Uncertainty, Information, and Sequential Experiments Annals of Mathematical Statistics. ,vol. 33, pp. 404- 419 ,(1962) , 10.1214/AOMS/1177704567
David J Spiegelhalter, Nicola G Best, Bradley P Carlin, Angelika Van Der Linde, None, Bayesian measures of model complexity and fit Journal of The Royal Statistical Society Series B-statistical Methodology. ,vol. 64, pp. 583- 639 ,(2002) , 10.1111/1467-9868.00353
Jose M. Bernardo, Expected Information as Expected Utility Annals of Statistics. ,vol. 7, pp. 686- 690 ,(1979) , 10.1214/AOS/1176344689
D. V. Lindley, On a Measure of the Information Provided by an Experiment Annals of Mathematical Statistics. ,vol. 27, pp. 986- 1005 ,(1956) , 10.1214/AOMS/1177728069
Ehsan S. Soofi, Capturing the Intangible Concept of Information Journal of the American Statistical Association. ,vol. 89, pp. 1243- 1254 ,(1994) , 10.1080/01621459.1994.10476865
Bradley Efron, How Biased is the Apparent Error Rate of a Prediction Rule Journal of the American Statistical Association. ,vol. 81, pp. 461- 470 ,(1986) , 10.1080/01621459.1986.10478291
J. F. C. Kingman, Solomon Kullback, Information Theory and Statistics The Mathematical Gazette. ,vol. 54, pp. 90- ,(1970) , 10.2307/3613211