On the Sublinear Regret of Distributed Primal-Dual Algorithms for Online Constrained Optimization

作者: Michael M. Zavlanos , Soomin Lee

DOI:

关键词:

摘要: This paper introduces consensus-based primal-dual methods for distributed online optimization where the time-varying system objective function $f_t(\mathbf{x})$ is given as sum of local agents' functions, i.e., $f_t(\mathbf{x}) = \sum_i f_{i,t}(\mathbf{x}_i)$, and constraint $\mathbf{g}(\mathbf{x})$ $\mathbf{g}(\mathbf{x}) \mathbf{g}_i (\mathbf{x}_i) \preceq \mathbf{0}$. At each stage, agent commits to an adaptive decision pertaining only past locally available information, incurs a new cost reflecting change in environment. Our algorithm uses weighted averaging iterates keep estimates global constraints dual variables. We show that achieves regret order $O(\sqrt{T})$ with time horizon $T$, scenarios when underlying communication topology jointly-connected. The measured regard value well violation. Numerical results routing wireless multi-hop networks uncertain channel rates are provided illustrate performance proposed algorithm.

参考文章(5)
Joseph W Durham, Antonio Franchi, Francesco Bullo, None, Distributed pursuit-evasion without mapping or global localization via local frontiers Autonomous Robots. ,vol. 32, pp. 81- 95 ,(2012) , 10.1007/S10514-011-9260-1
Michael Rabbat, Robert Nowak, Distributed optimization in sensor networks information processing in sensor networks. pp. 20- 27 ,(2004) , 10.1145/984622.984626
S. S. Ram, V. V. Veeravalli, A. Nedic, Distributed Non-Autonomous Power Control through Distributed Convex Optimization international conference on computer communications. pp. 3001- 3005 ,(2009) , 10.1109/INFCOM.2009.5062275
Martin Zinkevich, Online convex programming and generalized infinitesimal gradient ascent international conference on machine learning. pp. 928- 935 ,(2003)
A. Jadbabaie, Jie Lin, A.S. Morse, Coordination of groups of mobile autonomous agents using nearest neighbor rules IEEE Transactions on Automatic Control. ,vol. 48, pp. 988- 1001 ,(2003) , 10.1109/TAC.2003.812781