Finding optimal architecture and weights using evolutionary least square based learning

作者: R Ghosh , B Verma , None

DOI: 10.1109/ICONIP.2002.1202226

关键词: Feed forwardParity bitArtificial intelligenceLeast squaresHeuristicsComputer scienceGenetic algorithmProbabilistic logicData setComputational complexity theoryPoint (geometry)Time complexityPerceptron

摘要: In this paper, we present a novel idea of implementing growing neural network architecture using an evolutionary least square based algorithm. This paper focuses mainly on the following aspects, such as heuristics updating weights algorithm, finding number hidden neurons for two layer feed forward multilayered perceptron (MLP), stopping criteria algorithm and finally comparisons results with other traditional methods searching optimal or near solution in multidimensional complex search space comprising weight variables. We applied our proposed XOR data set, 10 bit odd parity problem many real bench mark set like handwriting dataset from CEDAR breast cancer, heart disease UCI ML repository. The comparison results, classification accuracy time complexity are discussed. also discuss issues probabilistic starting point method address problems involving fitness breaking.

参考文章(11)
David J. Montana, Training feedforward neural networks using genetic algorithms international joint conference on artificial intelligence. pp. 762- 767 ,(1989)
V. Petridis, S. Kazarlis, A. Papaikonomou, A. Filelis, A hybrid genetic algorithm for training neural networks international conference on artificial neural networks. pp. 953- 956 ,(1992) , 10.1016/B978-0-444-89488-5.50027-0
Tao Xiong, V. Cherkassky, A combined SVM and LDA approach for classification international joint conference on neural network. ,vol. 3, pp. 1455- 1459 ,(2005) , 10.1109/IJCNN.2005.1556089
B. Verma, R. Ghosh, A novel evolutionary neural learning algorithm congress on evolutionary computation. ,vol. 2, pp. 1884- 1889 ,(2002) , 10.1109/CEC.2002.1004530
A.P Topchy, O.A Lebedko, Neural network training by means of cooperative evolutionary search Nuclear Instruments & Methods in Physics Research Section A-accelerators Spectrometers Detectors and Associated Equipment. ,vol. 389, pp. 240- 241 ,(1997) , 10.1016/S0168-9002(97)00139-3
D Whitley, T Starkweather, C Bogart, Genetic algorithms and neural networks: optimizing connections and connectivity parallel computing. ,vol. 14, pp. 347- 361 ,(1990) , 10.1016/0167-8191(90)90086-O
Simon A. Barton, A matrix method for optimizing a neural network Neural Computation. ,vol. 3, pp. 450- 459 ,(1991) , 10.1162/NECO.1991.3.3.450
D.R. Hush, B.G. Horne, Progress in supervised neural networks IEEE Signal Processing Magazine. ,vol. 10, pp. 8- 39 ,(1993) , 10.1109/79.180705