A variational approximation for Bayesian networks with discrete and continuous latent variables

作者: Kevin P. Murphy

DOI:

关键词:

摘要: We show how to use a variational approximation the logistic function perform approximate inference in Bayesian networks containing discrete nodes with continuous parents. Essentially, we convert Gaussian, which facilitates exact inference, and then iteratively adjust parameters improve quality of approximation. demonstrate experimentally that this is much faster than sampling, but comparable accuracy. also introduce simple new technique for handling evidence, allows us handle arbitrary distributionson observed nodes, as well achieving significant speedup variables large cardinality.

参考文章(29)
H.-G. Leimer, Triangulated Graphs with Marked Vertices Annals of discrete mathematics. ,vol. 41, pp. 311- 324 ,(1988) , 10.1016/S0167-5060(08)70469-2
T. S. Jaakkola, M. I. Jordan, Variational methods and the QMR-DT database NATO advanced study institute on generalization in neural networks and machine learning. pp. 185- 214 ,(1998)
Tommi S. Jaakkola, Michael I. Jordan, Variational methods for inference and estimation in graphical models Massachusetts Institute of Technology. ,(1997)
Eric Driver, Darryl Morrell, Implementation of continuous Bayesian networks using sums of weighted Gaussians uncertainty in artificial intelligence. pp. 134- 140 ,(1995)
Michael I Jordan, Zoubin Ghahramani, Tommi S Jaakkola, Lawrence K Saul, None, An introduction to variational methods for graphical models Machine Learning. ,vol. 37, pp. 105- 161 ,(1999) , 10.1023/A:1007665907178
Kuo-Chu Chang, Robert Fung, Symbolic probabilistic inference with continuous variables uncertainty in artificial intelligence. pp. 77- 81 ,(1994) , 10.1016/B978-1-55860-203-8.50013-9
Peter McCullagh, John Ashworth Nelder, Generalized Linear Models ,(1983)
Nir Friedman, Moisés Goldszmidt, Discretizing continuous attributes while learning Bayesian networks international conference on machine learning. pp. 157- 165 ,(1996)
Ross D. Shachter, Mark A. Peot, Simulation Approaches to General Probabilistic Inference on Belief Networks uncertainty in artificial intelligence. ,vol. 10, pp. 221- 234 ,(1990) , 10.1016/B978-0-444-88738-2.50024-5
Finn V. Jensen, Frank Jensen, Optimal Junction Trees Uncertainty Proceedings 1994. pp. 360- 366 ,(1994) , 10.1016/B978-1-55860-332-5.50050-X