Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems

作者: Tianping Chen , Hong Chen

DOI: 10.1109/72.392253

关键词: Fixed pointDynamical systems theoryArtificial neural networkMathematical analysisFunction approximationDynamical system (definition)TopologyActivation functionMathematicsContinuous functionNonlinear system

摘要: The purpose of this paper is to investigate neural network capability systematically. main results are: 1) every Tauber-Wiener function qualified as an activation in the hidden layer a three-layered network; 2) for continuous S'(R/sup 1/) be function, necessary and sufficient condition that it not polynomial; 3) approximating nonlinear functionals defined on some compact set Banach space operators has been shown; 4) possibility by computation approximate output whole (not at fixed point) dynamical system, thus identifying system. >

参考文章(15)
I.W. Sandberg, Approximations for nonlinear functions IEEE Transactions on Circuits and Systems I-regular Papers. ,vol. 39, pp. 65- 67 ,(1992) , 10.1109/81.109247
Ken-Ichi Funahashi, On the approximate realization of continuous mappings by neural networks Neural Networks. ,vol. 2, pp. 183- 192 ,(1989) , 10.1016/0893-6080(89)90003-8
Carroll, Dickinson, Construction of neural nets using the radon transform international joint conference on neural network. pp. 607- 611 ,(1989) , 10.1109/IJCNN.1989.118639
Kurt Hornik, Approximation capabilities of multilayer feedforward networks Neural Networks. ,vol. 4, pp. 251- 257 ,(1991) , 10.1016/0893-6080(91)90009-T
Tianping Chen, Hong Chen, Ruey-wen Liu, Approximation capability in C(R~/sup n/) by multilayer feedforward networks and related problems IEEE Transactions on Neural Networks. ,vol. 6, pp. 25- 30 ,(1995) , 10.1109/72.363453
H.N Mhaskar, Charles A Micchelli, Approximation by superposition of sigmoidal and radial basis functions Advances in Applied Mathematics. ,vol. 13, pp. 350- 373 ,(1992) , 10.1016/0196-8858(92)90016-P
I.W. Sandberg, Approximation theorems for discrete-time systems IEEE Transactions on Circuits and Systems. ,vol. 38, pp. 564- 566 ,(1991) , 10.1109/31.76498
T. Chen, H. Chen, Approximations of continuous functionals by neural networks with application to dynamic systems IEEE Transactions on Neural Networks. ,vol. 4, pp. 910- 918 ,(1993) , 10.1109/72.286886