Error Stability Properties of Generalized Gradient-Type Algorithms

作者: M. V. Solodov , S. K. Zavriev

DOI: 10.1023/A:1022680114518

关键词:

摘要: We present a unified framework for convergence analysis of generalized subgradient-type algorithms in the presence perturbations. A principal novel feature our is that perturbations need not tend to zero limit. It established iterates are attracted, certain sense, an ɛ-stationary set problem, where ɛ depends on magnitude Characterization attraction sets given general (nonsmooth and nonconvex) case. The results further strengthened convex, weakly sharp, strongly convex problems. Our extends unifies previously known stability properties gradient subgradient methods, including their incremental, parallel, heavy ball modifications.

参考文章(25)
M. V. Solodov, Convergence Analysis of Perturbed Feasible Descent Methods Journal of Optimization Theory and Applications. ,vol. 93, pp. 337- 353 ,(1997) , 10.1023/A:1022602123316
Frank H. Clarke, Optimization and nonsmooth analysis ,(1983)
Boris T Poljak, Introduction to optimization Optimization Software, Publications Division. ,(1987)
Dimitri P. Bertsekas, A New Class of Incremental Gradient Methods for Least Squares Problems Siam Journal on Optimization. ,vol. 7, pp. 913- 926 ,(1997) , 10.1137/S1052623495287022
A.S. Leonov, Approximate calculation of a pseudoinverse matrix using a generalized discrepancy principle Ussr Computational Mathematics and Mathematical Physics. ,vol. 25, pp. 181- 182 ,(1986) , 10.1016/0041-5553(85)90092-8
David W. Peterson, Willard I. Zangwill, Nonlinear programming : a unified approach Econometrica. ,vol. 40, pp. 411- ,(1972) , 10.2307/1909424
S.K. Zavriev, Convergence properties of the gradient method under conditions of variable-level interference Ussr Computational Mathematics and Mathematical Physics. ,vol. 30, pp. 24- 32 ,(1990) , 10.1016/0041-5553(90)90040-Y
Ya. I. Alber, A. N. Iusem, M. V. Solodov, On the projected subgradient method for nonsmooth convex optimization in a Hilbert space Mathematical Programming. ,vol. 81, pp. 23- 35 ,(1998) , 10.1007/BF01584842
J. V. Burke, M. C. Ferris, Weak sharp minima in mathematical programming Siam Journal on Control and Optimization. ,vol. 31, pp. 1340- 1359 ,(1993) , 10.1137/0331063