Approximate Level Method for Nonsmooth Convex Minimization

作者: Peter Richtárik

DOI: 10.1007/S10957-011-9908-1

关键词: MathematicsMathematical optimizationFunction (mathematics)Feasible regionIntersection (set theory)Convex optimizationLevel setConvex functionTheory of computationRandom coordinate descent

摘要: In this paper, we propose and analyse an approximate variant of the level method Lemarechal, Nemirovskii Nesterov for minimizing nonsmooth convex functions. The main per-iteration work is spent on (i) a piecewise-linear model objective function (ii) projecting onto intersection feasible region set function. We show that, by replacing exact computations in both cases computations, relative scale, theoretical iteration complexity increases only small factor which depends approximation reduces to one case.

参考文章(17)
Yurii Nesterov, Arkadii Nemirovskii, Interior-Point Polynomial Algorithms in Convex Programming ,(1987)
Sehun Kim, Hyunsil Ahn, Seong-Cheol Cho, Variable target value subgradient method Mathematical Programming. ,vol. 49, pp. 359- 369 ,(1991) , 10.1007/BF01588797
Andrzej Cegielski, A method of projection onto an acute cone with level control in convex minimization Mathematical Programming. ,vol. 85, pp. 469- 490 ,(1999) , 10.1007/S101070050068
Krzysztof C. Kiwiel, Andrzej Ruszcayǹski, N. Z. Shor, Minimization methods for non-differentiable functions ,(1985)
Peter Richtárik, Improved Algorithms for Convex Minimization in Relative Scale Siam Journal on Optimization. ,vol. 21, pp. 1141- 1167 ,(2011) , 10.1137/090747142
Claude Lemaréchal, Arkadii Nemirovskii, Yurii Nesterov, New variants of bundle methods Mathematical Programming. ,vol. 69, pp. 111- 147 ,(1995) , 10.1007/BF01585555
Krzysztof Czesław Kiwiel, An aggregate subgradient method for nonsmooth convex minimization Mathematical Programming. ,vol. 27, pp. 320- 341 ,(1983) , 10.1007/BF02591907
Krzysztof C. Kiwiel, The Efficiency of Subgradient Projection Methods for Convex Optimization, Part II: Implementations and Extensions Siam Journal on Control and Optimization. ,vol. 34, pp. 677- 697 ,(1996) , 10.1137/S0363012994261483
Andrzej Cegielski, Robert Dylewski, Residual Selection in A Projection Method for Convex Minimization Problems Optimization. ,vol. 52, pp. 211- 220 ,(2003) , 10.1080/0233193031000079883