Mean-field approximation minimizes relative entropy
作者： Griff L. Bilbro , Wesley E. Snyder , Reinhold C. Mann
关键词:
摘要: We derive the mean-field approximation from information-theoretic principle of minimum relative entropy instead by minimizing Peierls’s inequality for Weiss free energy statistical physics theory. show that information theory leads to our mechanics procedure. As an example, we consider a problem in binary image restoration. find annealing compares favorably with stochastic approach.
osapublishing.org
harvard.edu参考文章(10)
Joel Louis Lebowitz, Cyril Domb, Melville S. Green, Phase Transitions and Critical Phenomena ,(1972)
George Wolberg, Theo Pavlidis, Restoration of binary images using stochastic relaxation with annealing Pattern Recognition Letters. ,vol. 3, pp. 375- 388 ,(1985) , 10.1016/0167-8655(85)90024-8
Stuart Geman, Donald Geman, Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. PAMI-6, pp. 721- 741 ,(1984) , 10.1109/TPAMI.1984.4767596
S. Kirkpatrick, C. D. Gelatt, M. P. Vecchi, Optimization by Simulated Annealing Science. ,vol. 220, pp. 671- 680 ,(1983) , 10.1126/SCIENCE.220.4598.671
Harish P. Hiriyannaiah, Reinhold C. Mann, Griff L. Bilbro, Wesley E. Snyder, Restoration of piecewise-constant images by mean-field annealing Journal of the Optical Society of America A. ,vol. 6, pp. 1901- 1912 ,(1989) , 10.1364/JOSAA.6.001901
C. Bagnuls, C. Bervillier, Field-theoretical approach to critical phenomena Physical Review B. ,vol. 41, pp. 402- 406 ,(1990) , 10.1103/PHYSREVB.41.402
Wesley E. Snyder, Griff L. Bilbro, Range Image Restoration Using Mean Field Annealing neural information processing systems. ,vol. 1, pp. 594- 601 ,(1988)
Julian Besag, Spatial Interaction and the Statistical Analysis of Lattice Systems Journal of the Royal Statistical Society: Series B (Methodological). ,vol. 36, pp. 192- 225 ,(1974) , 10.1111/J.2517-6161.1974.TB00999.X
D.E. Van den Bout, T.K. Miller, Graph partitioning using annealed neural networks IEEE Transactions on Neural Networks. ,vol. 1, pp. 192- 203 ,(1990) , 10.1109/72.80231
Asai Mitsuo, Yamada Minoru, Doi Toshio, Masuda Noboru, Hayashi Takehisa, NEURAL NETWORK COMPUTER ,(1990)