Fast parallel and adaptive updates for dual-decomposition solvers

作者: Alexander T. Ihler , Umut A. Acar , Özgur Sümer , Ramgopal R. Mettu

DOI:

关键词:

摘要: Dual-decomposition (DD) methods are quickly becoming important tools for estimating the minimum energy state of a graphical model. DD decompose complex model into collection simpler subproblems that can be solved exactly (such as trees), in combination provide upper and lower bounds on exact solution. Subproblem choice play major role: larger tend to improve bound more per iteration, while smaller enable highly parallel solvers benefit from re-using past solutions when there few changes between iterations. We propose an algorithm balance many these aspects speed up convergence. Our method uses cluster tree data structure has been proposed adaptive inference tasks, we apply it this paper dual-decomposition approximate inference. This approach allows us process large at each allowing high degree parallelizability taking advantage with sparse updates. For both synthetic inputs real-world stereo matching problem, demonstrate our is able achieve significant improvement convergence time.

参考文章(25)
Alexander T. Ihler, Özgür Sümer, Ramgopal R. Mettu, Umut A. Acar, Adaptive inference on general graphical models uncertainty in artificial intelligence. pp. 1- 8 ,(2008)
David M. Pennock, Logarithmic time parallel Bayesian inference uncertainty in artificial intelligence. pp. 431- 438 ,(1998)
Guy E. Blelloch, Umut A. Acar, Jorge L. Vittes, An Experimental Analysis of Change Propagation in Dynamic Trees ALENEX/ANALCO. pp. 41- 54 ,(2005)
Umut A. Acar, Alexander T. Ihler, Ramgopal R. Mettu, Ozgur Sumer, Adaptive updates for MAP configurations with applications to bioinformatics 2009 IEEE/SP 15th Workshop on Statistical Signal Processing. pp. 413- 416 ,(2009) , 10.1109/SSP.2009.5278552
Umut A. Acar, Guy E. Blelloch, Matthias Blume, Robert Harper, Kanat Tangwongsan, An experimental analysis of self-adjusting computation ACM Transactions on Programming Languages and Systems. ,vol. 32, pp. 3- ,(2009) , 10.1145/1596527.1596530
Guy E. Blelloch, Umut A. Acar, Jorge L. Vittes, Robert Harper, Shan Leung Maverick Woo, Dynamizing static algorithms, with applications to dynamic trees and history independence symposium on discrete algorithms. pp. 531- 540 ,(2004) , 10.5555/982792.982871
Charles E. Leiserson, The Cilk++ concurrency platform Proceedings of the 46th Annual Design Automation Conference on ZZZ - DAC '09. pp. 522- 527 ,(2009) , 10.1145/1629911.1630048
Ruy Ley-Wild, Matthew Fluet, Umut A. Acar, Compiling self-adjusting programs with continuations ACM SIGPLAN Notices. ,vol. 43, pp. 321- 334 ,(2008) , 10.1145/1411203.1411249
Daniel Scharstein, Richard Szeliski, A taxonomy and evaluation of dense two-frame stereo correspondence algorithms International Journal of Computer Vision. ,vol. 47, pp. 7- 42 ,(2001) , 10.1023/A:1014573219977
O. Veksler, Stereo Correspondence by Dynamic Programming on a Tree 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05). ,vol. 2, pp. 384- 390 ,(2005) , 10.1109/CVPR.2005.334