On the Optimal Step-size Selection for the Alternating Direction Method of Multipliers*

作者: Euhanna Ghadimi , André Teixeira , Iman Shames , Mikael Johansson

DOI: 10.3182/20120914-2-US-4030.00038

关键词:

摘要: The alternating direction method of multipliers is a powerful technique for structured large-scale optimization that has recently found applications in variety fields including networked optimization, estimation, compressed sensing and multi-agent systems. While this have received lot attention, there lack theoretical support how to set the algorithm parameters, its step-size typically tuned experimentally. In paper we consider three different formulations present explicit expressions minimizes convergence rate. We also compare our with one existing selection techniques consensus applications.

参考文章(23)
Gregory Quenell, Eigenvalue comparisons in graph theory. Pacific Journal of Mathematics. ,vol. 176, pp. 443- 461 ,(1996) , 10.2140/PJM.1996.176.443
Boris T Poljak, Introduction to optimization Optimization Software, Publications Division. ,(1987)
Markus Püschel, João M. F. Xavier, Pedro M. Q. Aguiar, João F. C. Mota, A Proof of Convergence For the Alternating Direction Method of Multipliers Applied to Polyhedral-Constrained Functions arXiv: Optimization and Control. ,(2011)
Jelmer van Ast, Robert Babuška, Bart De Schutter, Particle Swarms in Optimization and Control IFAC Proceedings Volumes. ,vol. 41, pp. 5131- 5136 ,(2008) , 10.3182/20080706-5-KR-1001.00862
Bo Wahlberg, Stephen Boyd, Mariette Annergren, Yang Wang, An ADMM Algorithm for a Class of Total Variation Regularized Estimation Problems IFAC Proceedings Volumes. ,vol. 45, pp. 83- 88 ,(2012) , 10.3182/20120711-3-BE-2027.00310
Angelia Nedic, Asuman Ozdaglar, Distributed Subgradient Methods for Multi-Agent Optimization IEEE Transactions on Automatic Control. ,vol. 54, pp. 48- 61 ,(2009) , 10.1109/TAC.2008.2009515
Junfeng Yang, Yin Zhang, Alternating Direction Algorithms for $\ell_1$-Problems in Compressive Sensing SIAM Journal on Scientific Computing. ,vol. 33, pp. 250- 278 ,(2011) , 10.1137/090777761
Lin Xiao, Stephen Boyd, Fast linear iterations for distributed averaging Systems & Control Letters. ,vol. 53, pp. 65- 78 ,(2004) , 10.1016/J.SYSCONLE.2004.02.022
Kai Cai, Hideaki Ishii, Average consensus on general strongly connected digraphs Automatica. ,vol. 48, pp. 2750- 2761 ,(2012) , 10.1016/J.AUTOMATICA.2012.08.003
Saverio Bolognani, Simone Del Favero, Luca Schenato, Damiano Varagnolo, Consensus‐based distributed sensor calibration and least‐square parameter identification in WSNs International Journal of Robust and Nonlinear Control. ,vol. 20, pp. 176- 193 ,(2010) , 10.1002/RNC.1452