Maximum entropy and conditional probability

作者: J. van Campenhout , T. Cover

DOI: 10.1109/TIT.1981.1056374

关键词:

摘要: It is well-known that maximum entropy distributions, subject to appropriate moment constraints, arise in physics and mathematics. In an attempt find a physical reason for the appearance of following theorem offered. The conditional distribution X_{l} given empirical observation (1/n)\sum^{n}_{i}=_{l}h(X_{i})=\alpha , where X_{1},X_{2}, \cdots are independent identically distributed random variables with common density g converges f_{\lambda}(x)=e^{\lambda^{t}h(X)}g(x) (Suitably normalized), \lambda chosen satisfy \int f_{lambda}(x)h(x)dx= \alpha . Thus variable X (normalized) product initial distribution. This when uniform. proof this related results relies heavily on work Zabell Lanford.

参考文章(9)
Oscar E. Lanford, Entropy and equilibrium states in classical statistical mechanics Statistical Mechanics and Mathematical Problems. ,vol. 20, pp. 1- 113 ,(1973) , 10.1007/BFB0112756
Kai Lai Chung, A Course in Probability Theory ,(1949)
Herman Chernoff, A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on the sum of Observations Annals of Mathematical Statistics. ,vol. 23, pp. 493- 507 ,(1952) , 10.1214/AOMS/1177729330
R. R. Bahadur, S. L. Zabell, Large Deviations of the Sample Mean in General Vector Spaces Annals of Probability. ,vol. 7, pp. 587- 621 ,(1979) , 10.1214/AOP/1176994985
Oldrich Alfonso Vasicek, A Conditional Law of Large Numbers Annals of Probability. ,vol. 8, pp. 142- 147 ,(1980) , 10.1214/AOP/1176994830
C.G. Darwin, R.H. Fowler, XLIV. On the partition of energy Philosophical Magazine Series 1. ,vol. 44, pp. 450- 479 ,(1922) , 10.1080/14786440908565189
Edwin T. Jaynes, Prior Probabilities IEEE Transactions on Systems Science and Cybernetics. ,(1968)
J. K. Ord, A. M. Kagan, Yu. V. Linnik, C. R. Rao, B. Ramachandran, Characterization Problems in Mathematical Statistics. Journal of the Royal Statistical Society. Series A (General). ,vol. 138, pp. 576- 577 ,(1975) , 10.2307/2345228