Region-based Energy Neural Network for Approximate Inference.

作者: Dong Liu , Ragnar Thobaben , Lars K. Rasmussen

DOI:

关键词: Mean field theoryInferenceMarginal distributionEnergy (signal processing)Approximate inferencePartition function (statistical mechanics)AlgorithmRandom fieldMarkov chainComputer scienceSampling (statistics)Belief propagationArtificial neural network

摘要: Region-based free energy was originally proposed for generalized belief propagation (GBP) to improve loopy (loopy BP). In this paper, we propose a neural network based model inference in general Markov random fields (MRFs), which directly minimizes the region-based defined on region graphs. We term our Energy Neural Network (RENN). Unlike message-passing algorithms, RENN avoids iterative message and is faster. Also different from recent deep models, by does not require sampling, works MRFs. can also be employed MRF learning. Our experiments marginal distribution estimation, partition function learning of MRFs show that outperforms mean field method, BP, GBP, state-of-the-art model.

参考文章(38)
Manfred Opper, David Saad, Advanced mean field methods: theory and practice Published in <b>2001</b> in Cambridge Mass) by MIT press. ,(2001)
Christopher M. Bishop, Pattern Recognition and Machine Learning (Information Science and Statistics) Springer-Verlag New York, Inc.. ,(2006)
Yee Whye Teh, Max Welling, Belief Optimization for Binary Networks: A Stable Alternative to Loopy Belief Propagation uncertainty in artificial intelligence. pp. 554- 561 ,(2001)
Thomas P. Minka, Yee Whye Teh, Max Welling, Structured region graphs: morphing EP into GBP uncertainty in artificial intelligence. pp. 609- 614 ,(2005)
Max Welling, Diederik P Kingma, Auto-Encoding Variational Bayes international conference on learning representations. ,(2014)
Ryoichi Kikuchi, A Theory of Cooperative Phenomena Physical Review. ,vol. 81, pp. 988- 1003 ,(1951) , 10.1103/PHYSREV.81.988
Jonathan S Yedidia, Yair Weiss, William T. Freeman, Generalized Belief Propagation neural information processing systems. ,vol. 13, pp. 689- 695 ,(2000)
Marco Pretti, A message-passing algorithm with damping Journal of Statistical Mechanics: Theory and Experiment. ,vol. 2005, pp. 11008- ,(2005) , 10.1088/1742-5468/2005/11/P11008