Artificial Neural Networks, Symmetries and Differential Evolution

作者: Orhan Arikan , Onay Urfalioglu

DOI:

关键词:

摘要: Neuroevolution is an active and growing research field, especially in times of increasingly parallel computing architectures. Learning methods for Artificial Neural Networks (ANN) can be divided into two groups. mainly based on Monte-Carlo techniques belongs to the group global search methods, whereas other such as backpropagation belong local methods. ANN's comprise important symmetry properties, which influence On hand, are generally unaffected by these symmetries. In literature, dealing with symmetries reported being not effective or even yielding inferior results. this paper, we introduce so called Minimum Global Optimum Proximity principle derived from theoretical considerations breaking, applied offline supervised learning. Using Differential Evolution (DE), a popular robust evolutionary optimization method, experimentally show significant efficiency improvements breaking.

参考文章(27)
Zbigniew Michalewicz, Genetic algorithms + data structures = evolution programs (2nd, extended ed.) Springer-Verlag New York, Inc.. ,(1994)
Jarmo Ilonen, Joni-Kristian Kamarainen, Jouni Lampinen, Differential Evolution Training Algorithm for Feed-Forward Neural Networks Neural Processing Letters. ,vol. 17, pp. 93- 105 ,(2003) , 10.1023/A:1022995128597
Jirí Síma, Minimizing the Quadratic Training Error of a Sigmoid Neuron Is Hard algorithmic learning theory. pp. 92- 105 ,(2001)
Results of the first international contest on evolutionary optimisation (1st ICEO) ieee international conference on evolutionary computation. pp. 611- 615 ,(1996) , 10.1109/ICEC.1996.542670
Rainer Storn, Kenneth Price, Differential Evolution – A Simple and Efficient Heuristic for Global Optimization over Continuous Spaces Journal of Global Optimization. ,vol. 11, pp. 341- 359 ,(1997) , 10.1023/A:1008202821328
Non-redundant genetic coding of neural networks ieee international conference on evolutionary computation. pp. 571- 575 ,(1996) , 10.1109/ICEC.1996.542662
David Klahr, Robert S. Siegler, The representation of children's knowledge. Advances in Child Development and Behavior. ,vol. 12, pp. 61- 116 ,(1978) , 10.1016/S0065-2407(08)60036-1