Extending factor graphs so as to unify directed and undirected graphical models

作者: Brendan J. Frey

DOI:

关键词:

摘要: The two most popular types of graphical model are Bayesian networks (BNs) and Markov random fields (MRFs). These offer complementary properties in construction, expressing conditional independencies, arbitrary factorizations joint distributions, formulating messagepassing inference algorithms. We show how the notation semantics factor graphs (a relatively new type model) can be extended so as to combine strengths BNs MRFs. Every BN or MRF easily converted a graph that expresses same factorization distribution, used for probabilistic through application single, simple message-passing algorithm. describe modified "Bayes-ball" algorithm establishing independence graphs, we form strict superset In particular, give an example commonly-used fragment, whose independencies cannot represented MRF, but graph. For readers who use chain further extension enables them represent graphs.

参考文章(9)
Marc Mézard, Giorgio Parisi, Riccardo Zecchina, Analytic and Algorithmic Solution of Random Satisfiability Problems Science. ,vol. 297, pp. 812- 815 ,(2002) , 10.1126/SCIENCE.1073287
Jonathan S Yedidia, Yair Weiss, William T. Freeman, Generalized Belief Propagation neural information processing systems. ,vol. 13, pp. 689- 695 ,(2000)
R. Gallager, Low-Density Parity-Check Codes ,(1963)
F.R. Kschischang, B.J. Frey, H.-A. Loeliger, Factor graphs and the sum-product algorithm IEEE Transactions on Information Theory. ,vol. 47, pp. 498- 519 ,(2001) , 10.1109/18.910572
Rina Dechter, Bucket elimination: a unifying framework for probabilistic inference uncertainty in artificial intelligence. pp. 211- 219 ,(1996)
Robert A Jacobs, Michael I Jordan, Steven J Nowlan, Geoffrey E Hinton, None, Adaptive mixtures of local experts Neural Computation. ,vol. 3, pp. 79- 87 ,(1991) , 10.1162/NECO.1991.3.1.79
Brendan J. Frey, Ralf Koetter, Nemanja Petrovic, Very loopy belief propagation for unwrapping phase images neural information processing systems. pp. 737- 743 ,(2001)
D.J.C. MacKay, R.M. Neal, Near Shannon limit performance of low density parity check codes Electronics Letters. ,vol. 33, pp. 457- 458 ,(1996) , 10.1049/EL:19970362