An evolutionary approach to black-box optimization on matrix manifolds

作者: Xiaoyu He , Yuren Zhou , Zefeng Chen , Siyu Jiang

DOI: 10.1016/J.ASOC.2020.106773

关键词:

摘要: Abstract Optimization on matrix manifolds is a class of methods for solving optimization problems, subject to constraints which admit the structure Riemannian manifold. These problems are intractable traditional evolutionary algorithms due non-Euclidean nature. This paper generalizes classical technique covariance adaptation manifolds, and proposes manifold evolution strategy named ManES. By exploiting structure, we turn an originally constrained problem into sequence unconstrained ones in Euclidean subspace. The proposed algorithm coordinate-free, sense that it independent choice basis requires no global coordinate system. All genetic operators take form transformations thus computationally efficient. exhibits state-of-the-art performance four benchmark one real-world application posed three different kinds manifolds.

参考文章(56)
S. Colutto, F. Fruhauf, M. Fuchs, O. Scherzer, The CMA-ES on Riemannian Manifolds to Reconstruct Shapes in 3-D Voxel Images IEEE Transactions on Evolutionary Computation. ,vol. 14, pp. 227- 245 ,(2010) , 10.1109/TEVC.2009.2029567
Nikolaus Hansen, Andreas Ostermeier, Completely Derandomized Self-Adaptation in Evolution Strategies Evolutionary Computation. ,vol. 9, pp. 159- 195 ,(2001) , 10.1162/106365601750190398
Ilhem Boussaïd, Julien Lepagnot, Patrick Siarry, A survey on optimization metaheuristics Information Sciences. ,vol. 237, pp. 82- 117 ,(2013) , 10.1016/J.INS.2013.02.041
F. vandenBergh, A.P. Engelbrecht, A Cooperative approach to particle swarm optimization IEEE Transactions on Evolutionary Computation. ,vol. 8, pp. 225- 239 ,(2004) , 10.1109/TEVC.2004.826069
Ulrike von Luxburg, A tutorial on spectral clustering Statistics and Computing. ,vol. 17, pp. 395- 416 ,(2007) , 10.1007/S11222-007-9033-Z
Nikolaus Hansen, Sibylle D Müller, Petros Koumoutsakos, None, Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES) Evolutionary Computation. ,vol. 11, pp. 1- 18 ,(2003) , 10.1162/106365603321828970
Thorsten Suttorp, Nikolaus Hansen, Christian Igel, Efficient covariance matrix update for variable metric evolution strategies Machine Learning. ,vol. 75, pp. 167- 197 ,(2009) , 10.1007/S10994-009-5102-1
Raghunandan H. Keshavan, Andrea Montanari, Sewoong Oh, Matrix Completion From a Few Entries IEEE Transactions on Information Theory. ,vol. 56, pp. 2980- 2998 ,(2010) , 10.1109/TIT.2010.2046205
Xiaodong Li, Xin Yao, Cooperatively Coevolving Particle Swarms for Large Scale Optimization IEEE Transactions on Evolutionary Computation. ,vol. 16, pp. 210- 224 ,(2012) , 10.1109/TEVC.2011.2112662
J.H. Manton, Optimization algorithms exploiting unitary constraints IEEE Transactions on Signal Processing. ,vol. 50, pp. 635- 650 ,(2002) , 10.1109/78.984753