The convergence rate of Newton-Raphson consensus optimization for quadratic cost functions

作者: Filippo Zanella , Damiano Varagnolo , Angelo Cenedese , Gianluigi Pillonetto , Luca Schenato

DOI: 10.1109/CDC.2012.6426750

关键词: Convex optimizationCompact convergenceQuadratically constrained quadratic programNewton's methodRate of convergenceQuadratic programmingDifferential dynamic programmingMathematicsSecond-order cone programmingMathematical optimization

摘要: We consider the convergence rates of two convex optimization strategies in context multi agent systems, namely Newton-Raphson consensus and a distributed Gradient-Descent opportunely derived from first. To allow analytical derivations, analyses are performed under simplificative assumption quadratic local cost functions. In this framework we derive sufficient conditions which guarantee algorithms. From these then obtain closed form expressions that can be used to tune parameters for maximizing rate convergence. Despite formulae have been functions assumptions, they as rules-of-thumb tuning algorithms general situations.

参考文章(21)
John N Tsitsiklis, PROBLEMS IN DECENTRALIZED DECISION MAKING AND COMPUTATION National Documentation Centre (EKT). ,(1984) , 10.12681/EADD/3778
Bernhard Schölkopf, Alexander J. Smola, Learning with Kernels The MIT Press. pp. 626- ,(2018) , 10.7551/MITPRESS/4175.001.0001
John N. Tsitsiklis, Dimitri P. Bertsekas, Parallel and Distributed Computation: Numerical Methods ,(1989)
S. Sundhar Ram, A. Nedić, V. V. Veeravalli, Incremental Stochastic Subgradient Algorithms for Convex Optimization Siam Journal on Optimization. ,vol. 20, pp. 691- 717 ,(2009) , 10.1137/080726380
Doron Blatt, Alfred O. Hero, Hillel Gauchman, A Convergent Incremental Gradient Method with a Constant Step Size Siam Journal on Optimization. ,vol. 18, pp. 29- 51 ,(2007) , 10.1137/040615961
Krzysztof C. Kiwiel, Convergence of Approximate and Incremental Subgradient Methods for Convex Optimization Siam Journal on Optimization. ,vol. 14, pp. 807- 840 ,(2003) , 10.1137/S1052623400376366
Jelmer van Ast, Robert Babuška, Bart De Schutter, Particle Swarms in Optimization and Control IFAC Proceedings Volumes. ,vol. 41, pp. 5131- 5136 ,(2008) , 10.3182/20080706-5-KR-1001.00862