Bounding Duality Gap for Problems with Separable Objective

作者: Stephen Boyd , Madeleine Udell

DOI:

关键词:

摘要: We consider the problem of minimizing a sum non-convex functions over compact domain, subject to linear inequality and equality constraints. Approximate solutions can be found by solving convexified version problem, in which each function objective is replaced its convex envelope. propose randomized algorithm solve finds an $\epsilon$-suboptimal solution original problem. With probability one, $\epsilon$ bounded term proportional number constraints The bound does not depend on variables or terms objective. In contrast previous related work, our proof constructive, self-contained, gives that tight.

参考文章(46)
Jonathan Eckstein, Masao Fukushima, Some Reformulations and Applications of the Alternating Direction Method of Multipliers Large Scale Optimization. pp. 115- 134 ,(1994) , 10.1007/978-1-4613-3632-7_7
Takafumi Kanamori, Akiko Takeda, Non-convex optimization on stiefel manifold and applications to machine learning international conference on neural information processing. pp. 109- 116 ,(2012) , 10.1007/978-3-642-34475-6_14
Panos M Pardalos, Convex Optimization Theory ,(2009)
M. Fortin, R. Glowinski, Chapter III On Decomposition-Coordination Methods Using an Augmented Lagrangian Studies in Mathematics and Its Applications. ,vol. 15, pp. 97- 146 ,(1983) , 10.1016/S0168-2024(08)70028-6
Anatoliy D. Rikun, A Convex Envelope Formula for Multilinear Functions Journal of Global Optimization. ,vol. 10, pp. 425- 437 ,(1997) , 10.1023/A:1008217604285
Adam M. Oberman, The convex envelope is the solution of a nonlinear obstacle problem Proceedings of the American Mathematical Society. ,vol. 135, pp. 1689- 1694 ,(2007) , 10.1090/S0002-9939-07-08887-9
M. Fazel, Mung Chiang, Network Utility Maximization With Nonconcave Utilities Using Sum-of-Squares Method conference on decision and control. pp. 1867- 1874 ,(2005) , 10.1109/CDC.2005.1582432
Veit Elser, Jonathan S. Yedidia, Nate Derbinsky, José Bento, An Improved Three-Weight Message-Passing Algorithm arXiv: Artificial Intelligence. ,(2013)