Two proximal splitting methods for multi-block separable programming with applications to stable principal component pursuit

作者: Min Sun , Hongchun Sun , Yiju Wang

DOI: 10.1007/S12190-017-1080-9

关键词:

摘要: Recent years have witnessed the rapid development of first order methods for multi-block separable programming involving large-scale date-set. The purpose this paper is to introduce two new methods, proximal splitting (PSMs), model under consideration. PSM fully utilizes desired property such problems and adopts Jacobian updating rule, which often results in easy subproblems practice. global convergence worst-case \(\mathcal {O}(1/t)\) rate an ergodic sense are proved condition that involved functions assumed be strongly convex. Applying hybrid Gauss–Seidel rule PSM, we derive second whose can guaranteed only Furthermore, its both non-ergodic senses also established. Finally, numerical on stable principal component pursuit reported testify accuracy speed some comparisons reported.

参考文章(28)
Liusheng Hou, Hongjin He, Junfeng Yang, A partially parallel splitting method for multiple-block separable convex programming with applications to robust PCA Computational Optimization and Applications. ,vol. 63, pp. 273- 303 ,(2016) , 10.1007/S10589-015-9770-4
Bingsheng He, Xiaoming Yuan, Wenxing Zhang, A customized proximal point algorithm for convex minimization with linear constraints Computational Optimization and Applications. ,vol. 56, pp. 559- 572 ,(2013) , 10.1007/S10589-013-9564-5
Miantao Chao, Caozong Cheng, A note on the convergence of alternating proximal gradient method Applied Mathematics and Computation. ,vol. 228, pp. 258- 263 ,(2014) , 10.1016/J.AMC.2013.11.101
Deren Han, Xiaoming Yuan, Wenxing Zhang, Xingju Cai, An ADM-based splitting method for separable convex programming Computational Optimization and Applications. ,vol. 54, pp. 343- 369 ,(2013) , 10.1007/S10589-012-9510-Y
Caihua Chen, Bingsheng He, Yinyu Ye, Xiaoming Yuan, The direct extension of ADMM for multi-block convex minimization problems is not necessarily convergent Mathematical Programming. ,vol. 155, pp. 57- 79 ,(2016) , 10.1007/S10107-014-0826-5
Bingsheng He, Min Tao, Xiaoming Yuan, Alternating Direction Method with Gaussian Back Substitution for Separable Convex Programming Siam Journal on Optimization. ,vol. 22, pp. 313- 340 ,(2012) , 10.1137/110822347
Kai Wang, Jitamitra Desai, Hongjin He, A note on augmented Lagrangian-based parallel splitting method Optimization Letters. ,vol. 9, pp. 1199- 1212 ,(2015) , 10.1007/S11590-014-0825-8
Guoyong Gu, Bingsheng He, Xiaoming Yuan, Customized proximal point algorithms for linearly constrained convex minimization and saddle-point problems: a unified approach Computational Optimization and Applications. ,vol. 59, pp. 135- 161 ,(2014) , 10.1007/S10589-013-9616-X
Bingsheng He, Han Liu, Zhaoran Wang, Xiaoming Yuan, A STRICTLY CONTRACTIVE PEACEMAN-RACHFORD SPLITTING METHOD FOR CONVEX PROGRAMMING. Siam Journal on Optimization. ,vol. 24, pp. 1011- 1040 ,(2014) , 10.1137/13090849X
Magnus R. Hestenes, Multiplier and gradient methods Journal of Optimization Theory and Applications. ,vol. 4, pp. 303- 320 ,(1969) , 10.1007/BF00927673