A Peaceman–Rachford Splitting Method with Monotone Plus Skew-Symmetric Splitting for Nonlinear Saddle Point Problems

作者: Weiyang Ding , Michael K. Ng , Wenxing Zhang

DOI: 10.1007/S10915-019-01034-W

关键词: Monotone polygonConvex optimizationLinear systemPositive-definite matrixKarush–Kuhn–Tucker conditionsSaddle pointApplied mathematicsConvexityHermitian matrixMathematics

摘要: This paper is devoted to solving the linearly constrained convex optimization problems by Peaceman–Rachford splitting method with monotone plus skew-symmetric on KKT operators. approach generalizes Hermitian and skew-Hermitian method, an unconditionally convergent algorithm for non-Hermitian positive definite linear systems, nonlinear scenario. The convergence of proposed guaranteed under some mild assumptions, e.g., strict convexity objective functions consistency constraints, even though Lions–Mercier property not fulfilled. In addition, we explore inexact version algorithm, which allows subproblems approximately inexactness criteria. Numerical simulations image restoration problem demonstrate compelling performance algorithm.

参考文章(51)
Patrick L. Combettes, Heinz H. Bauschke, Convex Analysis and Monotone Operator Theory in Hilbert Spaces ,(2011)
B. S. He, L. Z. Liao, Improvements of some projection methods for monotone nonlinear variational inequalities Journal of Optimization Theory and Applications. ,vol. 112, pp. 111- 128 ,(2002) , 10.1023/A:1013096613105
Tony F. Chan, Jianhong (Jackie) Shen, Image Processing And Analysis: Variational, Pde, Wavelet, And Stochastic Methods Image Processing and Analysis: Variational, PDE, Wavelet, and Stochastic Methods. ,(2005) , 10.1137/1.9780898717877
Hong Xu, Chen Feng, Baochun Li, Temperature Aware Workload Managementin Geo-Distributed Data Centers IEEE Transactions on Parallel and Distributed Systems. ,vol. 26, pp. 1743- 1753 ,(2015) , 10.1109/TPDS.2014.2325836
Roland Glowinski, On Alternating Direction Methods of Multipliers: A Historical Perspective Computational Methods in Applied Sciences. pp. 59- 82 ,(2014) , 10.1007/978-94-017-9054-3_4
Daniel O'Connor, Lieven Vandenberghe, Primal-Dual Decomposition by Operator Splitting and Applications to Image Deblurring ∗ Siam Journal on Imaging Sciences. ,vol. 7, pp. 1724- 1754 ,(2014) , 10.1137/13094671X
Alfred M. Bruckstein, David L. Donoho, Michael Elad, From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images Siam Review. ,vol. 51, pp. 34- 81 ,(2009) , 10.1137/060657704
Michele Benzi, Gene H. Golub, A Preconditioner for Generalized Saddle Point Problems SIAM Journal on Matrix Analysis and Applications. ,vol. 26, pp. 20- 41 ,(2005) , 10.1137/S0895479802417106
You-Wei Wen, R. H. Chan, Parameter selection for total-variation-based image restoration using discrepancy principle IEEE Transactions on Image Processing. ,vol. 21, pp. 1770- 1781 ,(2012) , 10.1109/TIP.2011.2181401
Caihua Chen, Bingsheng He, Yinyu Ye, Xiaoming Yuan, The direct extension of ADMM for multi-block convex minimization problems is not necessarily convergent Mathematical Programming. ,vol. 155, pp. 57- 79 ,(2016) , 10.1007/S10107-014-0826-5