Efficient and Adaptive Lagrange-Multiplier Methods for Nonlinear Continuous Global Optimization

作者: Benjamin W. Wah , Tao Wang

DOI: 10.1023/A:1008203422124

关键词: Mathematical optimizationFeasible regionLagrange multiplierMathematicsOptimization problemLagrangian relaxationGlobal optimizationSlack variableNonlinear programmingSaddle point

摘要: Lagrangian methods are popular in solving continuous constrained optimization problems. In this paper, we address three important issues applying to solve problems with inequality constraints. First, study transform constraints into equality constraints. An existing method, called the slack-variable adds a slack variable each constraint order it an constraint. Its disadvantage is that when search trajectory inside feasible region, some satisfied may still pose effect on function, leading possible oscillations and divergence local minimum lies boundary of region. To overcome problem, propose MaxQ method carries no Hence, minimizing function region always leads objective function. We also strategies speed up its convergence. Second, improve convergence without affecting solution quality. This done by adaptive-control strategy dynamically adjusts relative weights between part, better balance two faster convergence. Third, trace-based pull from one saddle point another fashion restarts. overcomes converges only requires random restarts look for new points, often missing good points vicinity already found. Finally, describe prototype Novel (Nonlinear Optimization via External Lead) implements our proposed present improved solutions collection benchmarks.

参考文章(36)
Zbigniew Michalewicz, Genetic Algorithms Plus Data Structures Equals Evolution Programs Springer-Verlag New York, Inc.. ,(1994)
Aimo Törn, Sami Viitanen, Topographical global optimization Recent advances in global optimization. pp. 384- 398 ,(1992) , 10.1515/9781400862528.384
P M Pardalos, Complexity in numerical optimization World Scientific. ,(1993) , 10.1142/2041
Benjamin W. Wah, Yao-Jen Chang, Trace-Based Methods for Solving Nonlinear Global Optimization and Satisfiability Problems Journal of Global Optimization. ,vol. 10, pp. 107- 141 ,(1997) , 10.1023/A:1008294209959
Reiner Horst, Tuy Hoang, Global Optimization: Deterministic Approaches ,(1992)
Benjamin W. Wah, Yi Shang, Global Search Methods For Solving Nonlinear Optimization Problems Global Search Methods For Solving Nonlinear Optimization Problems. ,(1997)
Panos M. Pardalos, J. Ben Rosen, Constrained Global Optimization: Algorithms and Applications ,(1987)
Panos M. Pardalos, Christodoulos A. Floudas, A Collection of Test Problems for Constrained Global Optimization Algorithms ,(1990)
Panos M. Pardalos, Christodoulos A. Floudas, Recent Advances in Global Optimization ,(1991)
Yi Shang, B.W. Wah, Global optimization for neural network training computational science and engineering. ,vol. 29, pp. 45- 54 ,(1996) , 10.1109/2.485892