Investigating generalization in parallel evolutionary artificial neural networks

作者: Wolfram-M. Lippe , Kristina Davoian

DOI:

关键词:

摘要: In this paper we study how the parallelization of a learning algorithm affects generalization ability Evolutionary Artificial Neural Networks (EANNs). The newly proposed evolutionary (EA), which improves chromosomes according to characteristics their genotype and phenotype, was used for evolving ANNs. EA has been parallelized by two schemes: migration approach, periodically exchanges best individuals between all parallel populations, recently developed migration-strangers strategy, extends search space during evolution replacement worst in populations with randomly generated new ones, called strangers. experiments have provided on Mackey-Glass chaotic time series problem order determine average prediction errors training testing data small large ANNs, evolved both algorithms (PEAs). results showed that PEAs enable produce compact ANNs high precision prediction, insignificant distinctions errors.

参考文章(22)
Kristina Davoian, Alexander Reichel, Wolfram-Manfred Lippe, Comparison and Analysis of Mutation-based Evolutionary Algorithms for ANN Parameters Optimization. DMIN. pp. 51- 56 ,(2006)
Kristina Davoian, Search space extension and PGAs: a comparative study of parallelization schemes to genetic algorithms using the TSP international conference on artificial intelligence and applications. pp. 26- 30 ,(2006)
Gerrit A. Riessen, Graham J. Williams, Xin Yao, PEPNet: Parallel Evolutionary Programming for Constructing Artificial Neural Networks Evolutionary Programming. pp. 35- 46 ,(1997) , 10.1007/BFB0014799
Ron Shonkwiler, Parallel Genetic Algorithms international conference on genetic algorithms. pp. 199- 205 ,(1993)
R. Hinterding, Gaussian mutation and self-adaption for numeric genetic algorithms ieee international conference on evolutionary computation. ,vol. 1, pp. 384- ,(1995) , 10.1109/ICEC.1995.489178
Ludwig Neise, Dirk Rischke, Horst Stöcker, Walter Greiner, Thermodynamics and Statistical Mechanics ,(2011)
Wolfram-M. Lippe, Kristina Davoian, A New Self-Adaptive EP Approach for ANN Weights Training World Academy of Science, Engineering and Technology, International Journal of Computer, Electrical, Automation, Control and Information Engineering. ,vol. 2, pp. 845- 850 ,(2008)
Ankit Jain, David B. Fogel, Case studies in applying fitness distributions in evolutionary algorithms: I. Simple neural networks and Gaussion mutation Applications and science of computational intelligence. Conference. ,vol. 4055, pp. 168- 175 ,(2000) , 10.1117/12.380569
Ajith Abraham, None, Meta learning evolutionary artificial neural networks Neurocomputing. ,vol. 56, pp. 1- 38 ,(2004) , 10.1016/S0925-2312(03)00369-2
XIN YAO, EVOLUTIONARY ARTIFICIAL NEURAL NETWORKS International Journal of Neural Systems. ,vol. 4, pp. 203- 222 ,(1993) , 10.1142/S0129065793000171