Smoothing technique for nonsmooth composite minimization with linear operator

作者: Volkan Cevher , Olivier Fercoq , Quang Van Nguyen

DOI:

关键词: Computer scienceConvex optimizationLinear mapBasis pursuitSmoothingApplied mathematicsAcceleration (differential geometry)Differentiable functionRate of convergenceConvex function

摘要: We introduce and analyze an algorithm for the minimization of convex functions that are sum differentiable terms proximable composed with linear operators. The method builds upon recently developed smoothed gap technique. In addition to a precise convergence rate result, valid even in presence inclusion constraints, this new allows explicit treatment gradient can be enhanced line-search. also study consequences restarting acceleration at given frequency. These features not classical primal-dual methods allow us solve difficult large-scale optimization problems. numerically illustrate superior performance on basis pursuit, TV-regularized least squares regression L1 problems against state-of-the-art.

参考文章(14)
Matthias Rupp, Machine learning for quantum mechanics in a nutshell International Journal of Quantum Chemistry. ,vol. 115, pp. 1058- 1073 ,(2015) , 10.1002/QUA.24954
Yu Nesterov, Universal gradient methods for convex optimization problems Mathematical Programming. ,vol. 152, pp. 381- 404 ,(2015) , 10.1007/S10107-014-0790-0
Laurent Condat, A primal-dual splitting method for convex optimization involving Lipschitzian, proximable and linear composite terms Journal of Optimization Theory and Applications. ,vol. 158, pp. 460- 479 ,(2013) , 10.1007/S10957-012-0245-9
Patrick L. Combettes, Jean-Christophe Pesquet, Primal-Dual Splitting Algorithm for Solving Inclusions with Mixtures of Composite, Lipschitzian, and Parallel-Sum Type Monotone Operators Set-valued and Variational Analysis. ,vol. 20, pp. 307- 330 ,(2012) , 10.1007/S11228-011-0191-Y
Patrick L Combettes, Băng C Vũ, None, Variable metric forward–backward splitting with applications to monotone inclusions in duality Optimization. ,vol. 63, pp. 1289- 1318 ,(2014) , 10.1080/02331934.2012.733883
Tom Goldstein, Brendan O'Donoghue, Simon Setzer, Richard Baraniuk, Fast Alternating Direction Optimization Methods Siam Journal on Imaging Sciences. ,vol. 7, pp. 1588- 1623 ,(2014) , 10.1137/120896219
Amir Beck, Marc Teboulle, A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems Siam Journal on Imaging Sciences. ,vol. 2, pp. 183- 202 ,(2009) , 10.1137/080716542
Bằng Công Vũ, A splitting algorithm for dual monotone inclusions involving cocoercive operators Advances in Computational Mathematics. ,vol. 38, pp. 667- 681 ,(2013) , 10.1007/S10444-011-9254-8
S. M. Tom, C. R. Fox, C. Trepel, R. A. Poldrack, The Neural Basis of Loss Aversion in Decision-Making Under Risk Science. ,vol. 315, pp. 515- 518 ,(2007) , 10.1126/SCIENCE.1134239
A. Beck, M. Teboulle, Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems IEEE Transactions on Image Processing. ,vol. 18, pp. 2419- 2434 ,(2009) , 10.1109/TIP.2009.2028250