Quantized Decentralized Consensus Optimization

作者: Amirhossein Reisizadeh , Aryan Mokhtari , Hamed Hassani , Ramtin Pedarsani

DOI: 10.1109/CDC.2018.8619539

关键词:

摘要: We consider the problem of decentralized consensus optimization, where sum $n$ convex functions are minimized over distributed agents that form a connected network. In particular, we case communicated local decision variables among nodes quantized in order to alleviate communication bottleneck optimization. propose Quantized Decentralized Gradient Descent (QDGD) algorithm, which update their by combining information received from neighbors with information. prove under standard strong convexity and smoothness assumptions for cost functions, QDGD achieves vanishing mean solution error. To best our knowledge, this is first algorithm error presence quantization noise. Moreover, provide simulation results show tight agreement between derived theoretical convergence rate experimental results.

参考文章(35)
Sedar Yuksel, Tamer Basar, Quantization and coding for decentralized LTI systems conference on decision and control. ,vol. 3, pp. 2847- 2852 ,(2003) , 10.1109/CDC.2003.1273057
John N Tsitsiklis, PROBLEMS IN DECENTRALIZED DECISION MAKING AND COMPUTATION National Documentation Centre (EKT). ,(1984) , 10.12681/EADD/3778
Kun Yuan, Qing Ling, Wotao Yin, On the Convergence of Decentralized Gradient Descent Siam Journal on Optimization. ,vol. 26, pp. 1835- 1854 ,(2016) , 10.1137/130943170
Wei Ren, Randal W Beard, Ella M Atkins, Information consensus in multivehicle cooperative control IEEE Control Systems Magazine. ,vol. 27, pp. 71- 82 ,(2007) , 10.1109/MCS.2007.338264
Tuncer C. Aysal, Mark Coates, Michael Rabbat, Distributed Average Consensus using Probabilistic Quantization 2007 IEEE/SP 14th Workshop on Statistical Signal Processing. pp. 640- 644 ,(2007) , 10.1109/SSP.2007.4301337
Ermin Wei, Asuman Ozdaglar, Ali Jadbabaie, A Distributed Newton Method for Network Utility Maximization–I: Algorithm IEEE Transactions on Automatic Control. ,vol. 58, pp. 2162- 2175 ,(2013) , 10.1109/TAC.2013.2253218
Yongcan Cao, Wenwu Yu, Wei Ren, Guanrong Chen, An Overview of Recent Progress in the Study of Distributed Multi-Agent Coordination IEEE Transactions on Industrial Informatics. ,vol. 9, pp. 427- 438 ,(2013) , 10.1109/TII.2012.2219061
Alejandro Ribeiro, Ergodic Stochastic Optimization Algorithms for Wireless Communication and Networking IEEE Transactions on Signal Processing. ,vol. 58, pp. 6369- 6386 ,(2010) , 10.1109/TSP.2010.2057247
Angelia Nedic, Asuman Ozdaglar, Distributed Subgradient Methods for Multi-Agent Optimization IEEE Transactions on Automatic Control. ,vol. 54, pp. 48- 61 ,(2009) , 10.1109/TAC.2008.2009515
Mahmoud El Chamie, Ji Liu, Tamer Basar, Design and analysis of distributed averaging with quantized communication conference on decision and control. ,vol. 61, pp. 3860- 3865 ,(2014) , 10.1109/CDC.2014.7039988