Estimating Functions of Distributions from A Finite Set of Samples, Part 2: Bayes Estimators for Mutual Information, Chi-Squared, Covariance and other Statistics
作者： David H. Wolpert , David R. Wolf
DOI:
关键词:
摘要: We present estimators for entropy and other functions of a discrete probability distribution when the data is finite sample drawn from that distribution. In particular, case joint distribution, we mutual information, covariance, chi-squared
harvard.edu
arxiv.org参考文章(12)
Wentian Li, Mutual Information Functions of Natural Language Texts ,(1989)
Satosi Watanabe, Pattern Recognition: Human and Mechanical ,(1985)
C. E. M. Strauss, D. H. Wolpert, D. R. Wolf, Alpha, Evidence, and the Entropic Prior Springer, Dordrecht. pp. 113- 120 ,(1993) , 10.1007/978-94-017-2217-9_15
David H. Wolpert, David R. Wolf, Estimating Functions of Probability Distributions from a Finite Set of Samples, Part 1: Bayes Estimators and the Shannon Entropy arXiv: Cellular Automata and Lattice Gases. ,(1994)
J. Skilling, S.F. Gull, Maximum entropy method in image processing IEE Proceedings F Communications, Radar and Signal Processing. ,vol. 131, pp. 646- 659 ,(1984) , 10.1049/IP-F-1:19840099
Richard W. Hamming, Coding and information theory (2nd ed.) Prentice-Hall, Inc.. ,(1986)
Wentian Li, Mutual information functions versus correlation functions Journal of Statistical Physics. ,vol. 60, pp. 823- 837 ,(1990) , 10.1007/BF01025996
N. N. Lebedev, D. B. Livhtenberg, Richard A. Silverman, Special functions and their applications ,(1965)
Walter Rudin, Principles of mathematical analysis ,(1964)
Donald A. McQuarrie, Handbook of Mathematical Functions American Journal of Physics. ,vol. 34, pp. 177- 177 ,(1966) , 10.1119/1.1972842