Constrained optimization via stochastic approximation with a simultaneous perturbation gradient approximation

作者: Payman Sadegh

DOI: 10.1016/S0005-1098(96)00230-0

关键词:

摘要: This paper deals with a projection algorithm for stochastic approximation using simultaneous perturbation gradient optimization under inequality constraints where no direct of the loss function is available and are given as explicit functions parameters. It shown that, application algorithm, parameter iterate converges almost surely to Kuhn-Tucker point. The procedure illustrated by numerical example.

参考文章(9)
Lennart Ljung, Georg Pflug, Harro Walk, Stochastic Approximation and Optimization of Random Systems ,(1992)
Gert Cauwenberghs, Analog VLSI autonomous systems for learning and optimization California Institute of Technology. ,(1994) , 10.7907/CW78-8H63.
Pierre L'Ecuyer, Peter W. Glynn, Stochastic Optimization by Simulation: Convergence Proofs for the GI/G/1 Queue in Steady-State Management Science. ,vol. 40, pp. 1562- 1578 ,(1994) , 10.1287/MNSC.40.11.1562
J.C. Spall, Multivariate stochastic approximation using a simultaneous perturbation gradient approximation IEEE Transactions on Automatic Control. ,vol. 37, pp. 332- 341 ,(1992) , 10.1109/9.119632
Yutaka Maeda, Hiroaki Hirano, Yakichi Kanata, A learning rule of neural networks via simultaneous perturbation and its hardware implementation Neural Networks. ,vol. 8, pp. 251- 259 ,(1995) , 10.1016/0893-6080(94)00084-Y
K. B. Haley, The Continuous Maximum Principle Journal of the Operational Research Society. ,vol. 18, pp. 332- 333 ,(1967) , 10.1057/JORS.1967.63