Approximate inference by intersecting semidefinite bound and local polytope

作者: Nathan Srebro , Jian Peng , Jinbo Xu , Tamir Hazan

DOI:

关键词: Graphical modelComputational complexity theoryOptimization problemApproximate inferenceRegular polygonInferenceMathematical optimizationPolytopeMathematicsBelief propagation

摘要: Inference in probabilistic graphical models can be represented as a constrained optimization problem of free-energy functional. Substantial research has been focused on the approximation constraint set, also known marginal polytope. This paper presents novel inference algorithm that tightens and solves by intersecting popular local polytope semidefinite outer bound Using dual decomposition, our method separates into two subproblems: program (SDP), which is solved low-rank SDP algorithm, based problem, convex belief propagation. Our very reasonable computational complexity its actual running time typically within small factor ( 10) Tested both synthetic data real-world protein sidechain packing benchmark, significantly outperforms tree-reweighted propagation probability MAP inference. competitive with state-of-the-art MRF inference, solving all tasks recently presented MPLP [19], beating lattices strong edge potentials.

参考文章(24)
Tommi Jaakkola, Amir Globerson, Talya Meltzer, Yair Weiss, David Sontag, Tightening LP relaxations for MAP using message passing uncertainty in artificial intelligence. pp. 503- 510 ,(2008)
Ofer Meshi, Amir Globerson, Nir Friedman, Ariel Jaimovich, Convexifying the Bethe free energy uncertainty in artificial intelligence. pp. 402- 410 ,(2009)
Michel X. Goemans, David P. Williamson, Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming Journal of the ACM. ,vol. 42, pp. 1115- 1145 ,(1995) , 10.1145/227683.227684
Bernard Chazelle, Carl Kingsford, Mona Singh, A Semidefinite Programming Approach to Side Chain Positioning with New Rounding Strategies Informs Journal on Computing. ,vol. 16, pp. 380- 392 ,(2004) , 10.1287/IJOC.1040.0096
Joel Tropp, Nathan Srebro, Ben Recht, Ruslan R Salakhutdinov, Jason D Lee, Practical Large-Scale Optimization for Max-norm Regularization neural information processing systems. ,vol. 23, pp. 1297- 1305 ,(2010)
M.J. Wainwright, T.S. Jaakkola, A.S. Willsky, MAP estimation via agreement on trees: message-passing and linear programming IEEE Transactions on Information Theory. ,vol. 51, pp. 3697- 3717 ,(2005) , 10.1109/TIT.2005.856938
M.P. Kumar, P.H.S. Torr, A. Zisserman, Solving Markov Random Fields using Second Order Cone Programming Relaxations computer vision and pattern recognition. ,vol. 1, pp. 1045- 1052 ,(2006) , 10.1109/CVPR.2006.283
Nikos Komodakis, Nikos Paragios, Georgios Tziritas, MRF Optimization via Dual Decomposition: Message-Passing Revisited international conference on computer vision. pp. 1- 8 ,(2007) , 10.1109/ICCV.2007.4408890
T. Heskes, Convexity arguments for efficient minimization of the Bethe and Kikuchi free energies Journal of Artificial Intelligence Research. ,vol. 26, pp. 153- 190 ,(2006) , 10.1613/JAIR.1933
Inderjit S. Dhillon, Brian Kulis, Suvrit Sra, Convex Perturbations for Scalable Semidefinite Programming international conference on artificial intelligence and statistics. ,vol. 5, pp. 296- 303 ,(2009)