Fast Bundle-Level Type Methods for Unconstrained and Ball-Constrained Convex Optimization

作者: Yunmei Chen , Guanghui Lan , Yuyuan Ouyang , Wei Zhang

DOI: 10.1007/S10589-019-00071-3

关键词:

摘要: It has been shown in (14) that the accelerated prox-level (APL) method and its variant, uniform smoothing level (USL) method, have optimal iteration complexity for solving black-box structured convex programming problems without requiring input of any smoothness information. However, these algorithms require assumption on boundedness feasible set their eciency relies solutions two involved subproblems. These hindered applicability large-scale unconstrained optimization problems. In this paper, we rst present a generic algorithmic framework to extend uniformly methods Moreover, introduce new variants methods, i.e., fast APL (FAPL) USL (FUSL) large scale respectively. Both FAPL FUSL enjoy same as USL, while number subproblems each is reduced from one. an exact solve only subproblem algorithms. As result, proposed improved performance practice signicantly terms both computational time solution quality. Our numerical results some least square total variation based image reconstruction great advantages bundle-level type over APL, other state-of-the-art rst-order methods.

参考文章(39)
C. Lemarechal, An extension of davidon methods to non differentiable problems Nondifferentiable Optimization. pp. 95- 109 ,(1975) , 10.1007/BFB0120700
Wei Deng, Wotao Yin, On the Global and Linear Convergence of the Generalized Alternating Direction Method of Multipliers Journal of Scientific Computing. ,vol. 66, pp. 889- 916 ,(2016) , 10.1007/S10915-015-0048-X
Peter Richtárik, Approximate Level Method for Nonsmooth Convex Minimization Journal of Optimization Theory and Applications. ,vol. 152, pp. 334- 350 ,(2012) , 10.1007/S10957-011-9908-1
Yuyuan Ouyang, Yunmei Chen, Guanghui Lan, Eduardo Pasiliao, An Accelerated Linearized Alternating Direction Method of Multipliers Siam Journal on Imaging Sciences. ,vol. 8, pp. 644- 681 ,(2014) , 10.1137/14095697X
A. Astorino, A. Frangioni, M. Gaudioso, E. Gorgone, Piecewise-quadratic Approximations in Convex Numerical Optimization Siam Journal on Optimization. ,vol. 21, pp. 1418- 1438 ,(2011) , 10.1137/100817930
Aharon Ben-Tal, Arkadi Nemirovski, Non-euclidean restricted memory level method for large-scale convex optimization Mathematical Programming. ,vol. 102, pp. 407- 456 ,(2005) , 10.1007/S10107-004-0553-4
Wim van Ackooij, Claudia Sagastizábal, Constrained Bundle Methods for Upper Inexact Oracles with Application to Joint Chance Constrained Energy Problems Siam Journal on Optimization. ,vol. 24, pp. 733- 765 ,(2014) , 10.1137/120903099
Donald Goldfarb, Shiqian Ma, Katya Scheinberg, Fast alternating linearization methods for minimizing the sum of two convex functions Mathematical Programming. ,vol. 141, pp. 349- 382 ,(2013) , 10.1007/S10107-012-0530-2
Stanley Osher, Martin Burger, Donald Goldfarb, Jinjun Xu, Wotao Yin, An Iterative Regularization Method for Total Variation-Based Image Restoration Multiscale Modeling & Simulation. ,vol. 4, pp. 460- 489 ,(2005) , 10.1137/040605412