Statistical inference, Occam's razor, and statistical mechanics on the space of probability distributions
DOI: 10.1162/NECO.1997.9.2.349
关键词:
摘要: The task of parametric model selection is cast in terms of a statistical mechanics on the space of probability distributions. Using the techniques of low-temperature expansions, I arrive at …
mitpressjournals.org
core.ac.uk
harvard.edu
acm.org
arxiv.org 参考文章(20)
C. S. Wallace, P. R. Freeman, Estimation and Inference by Compact Coding Journal of the royal statistical society series b-methodological. ,vol. 49, pp. 240- 252 ,(1987) , 10.1111/J.2517-6161.1987.TB01695.X
Shun-ichi Amari, Differential-geometrical methods in statistics ,(1985)
Jorma Rissanen, Stochastic Complexity and Modeling Annals of Statistics. ,vol. 14, pp. 1080- 1100 ,(1986) , 10.1214/AOS/1176350051
Joseph J. Atick, Could information theory provide an ecological theory of sensory processing Network: Computation In Neural Systems. ,vol. 3, pp. 213- 251 ,(1992) , 10.3109/0954898X.2011.638888
Marc Potters, William Bialek, Statistical mechanics and visual signal processing Journal De Physique I. ,vol. 4, pp. 1755- 1775 ,(1994) , 10.1051/JP1:1994219
Andrew R Barron, Thomas M Cover, None, Minimum complexity density estimation IEEE Transactions on Information Theory. ,vol. 37, pp. 1034- 1054 ,(1991) , 10.1109/18.86996
N. Murata, S. Yoshizawa, S. Amari, Network information criterion-determining the number of hidden units for an artificial neural network model IEEE Transactions on Neural Networks. ,vol. 5, pp. 865- 872 ,(1994) , 10.1109/72.329683
Thomas M. Cover, Joy A. Thomas, Elements of information theory ,(1991)
K. Yamanishi, A decision-theoretic extension of stochastic complexity and its applications to learning IEEE Transactions on Information Theory. ,vol. 44, pp. 1424- 1439 ,(1998) , 10.1109/18.681319
R.R. de Ruyter Van Steveninck, W. Bialek, M. Potters, R.H. Carlson, Statistical adaptation and optimal estimation in movement computation by the blowfly visual system systems, man and cybernetics. ,vol. 1, pp. 302- 307 ,(1994) , 10.1109/ICSMC.1994.399855