Fractional-order Backpropagation Neural Networks: Modified Fractional-order Steepest Descent Method for Family of Backpropagation Neural Networks.

作者: Jian Wang , Yi-Fei Pu

DOI:

关键词: Artificial neural networkComputer scienceAlgorithmPartial derivativeSingularityFractional calculusBackpropagationGlobal optimizationMethod of steepest descentFunction approximation

摘要: This paper offers a novel mathematical approach, the modified Fractional-order Steepest Descent Method (FSDM) for training BackPropagation Neural Networks (BPNNs); this differs from majority of previous approaches and as such. A promising method, fractional calculus, has potential to assume prominent role in applications neural networks cybernetics because its inherent strengths such long-term memory, nonlocality, weak singularity. Therefore, improve optimization performance classic first-order BPNNs, we study whether it could be possible FSDM generalize BPNNs based Backpropagation (FBPNNs). Motivated by inspiration, proposes state-of-the-art application calculus implement FBPNN whose reverse incremental search is negative directions approximate fractional-order partial derivatives square error. At first, theoretical concept described mathematically. Then, proof global optimal convergence, an assumption structure, multi-scale are analysed detail. Finally, perform comparative experiments compare with BPNN, i.e., example function approximation, optimization, two performances real data. The more efficient searching capability determine solution major advantage being superior BPNN.

参考文章(41)
Igor Podlubny, I Petras, Blas M Vinagre, P O'Leary, L Dorcak, Analogue Realizations of Fractional-Order Controllers Nonlinear Dynamics. ,vol. 29, pp. 281- 296 ,(2002) , 10.1023/A:1016556604320
David F. Shanno, Recent advances in numerical techniques for large scale optimization Neural networks for control. pp. 171- 178 ,(1990)
David E. Rumelhart, Geoffrey E. Hinton, Ronald J. Williams, Learning representations by back-propagating errors Nature. ,vol. 323, pp. 696- 699 ,(1988) , 10.1038/323533A0
Yuriy A. Rossikhin, Marina V. Shitikova, Applications of Fractional Calculus to Dynamic Problems of Linear and Nonlinear Hereditary Mechanics of Solids Applied Mechanics Reviews. ,vol. 50, pp. 15- 67 ,(1997) , 10.1115/1.3101682
M. Andramonov, A. Rubinov, B. Glover, Cutting angle methods in global optimization Applied Mathematics Letters. ,vol. 12, pp. 95- 100 ,(1999) , 10.1016/S0893-9659(98)00179-7
Ahmed Elwakil, Fractional-Order Circuits and Systems: An Emerging Interdisciplinary Research Area IEEE Circuits and Systems Magazine. ,vol. 10, pp. 40- 50 ,(2010) , 10.1109/MCAS.2010.938637
A.K. Rigler, J.M. Irvine, T.P. Vogl, Rescaling of variables in back propagation learning Neural Networks. ,vol. 4, pp. 225- 229 ,(1991) , 10.1016/0893-6080(91)90006-Q