Wavelet neural networks are asymptotically optimal approximators for functions of one variable

作者: V. Kreinovich , O. Sirisaengtaksin , S. Cabrera

DOI: 10.1109/ICNN.1994.374179

关键词:

摘要: Neural networks are universal approximators. For example, it has been proved (K. Hornik et al., 1989) that for every /spl epsiv/>0 an arbitrary continuous function on a compact set can be epsiv/-approximated by 3-layer neural network. This and other results prove in principle, any (e.g., control) implemented appropriate But why networks? In addition to networks, also approximated polynomials, etc. What is so special about make them preferable approximators? To compare different approximators, one the number of bits we must store order able reconstruct with given precision epsiv/. weights thresholds. coefficients, We consider functions variable, show some neurons (corresponding wavelets), optimal approximators sense they require (asymptotically) smallest possible bits. >

参考文章(18)
Yves Meyer, Wavelets and Operators ,(1993)
Harold H Szu, Brian A Telfer, Shubha L Kadambe, Neural network adaptive wavelets for signal representation and classification Optical Engineering. ,vol. 31, pp. 1907- 1916 ,(1992) , 10.1117/12.59918
Ken-Ichi Funahashi, On the approximate realization of continuous mappings by neural networks Neural Networks. ,vol. 2, pp. 183- 192 ,(1989) , 10.1016/0893-6080(89)90003-8
Kurt Hornik, Approximation capabilities of multilayer feedforward networks Neural Networks. ,vol. 4, pp. 251- 257 ,(1991) , 10.1016/0893-6080(91)90009-T
Harold H. Szu, Xiang-Yang Yang, Brian A. Telfer, Yunlong Sheng, Neural network and wavelet transform for scale-invariant data classification. Physical Review E. ,vol. 48, pp. 1497- 1501 ,(1993) , 10.1103/PHYSREVE.48.1497
Edward K. Blum, Leong Kwan Li, Approximation theory and feedforward networks Neural Networks. ,vol. 4, pp. 511- 515 ,(1991) , 10.1016/0893-6080(91)90047-9
Ingrid Daubechies, Ten Lectures on Wavelets ,(1992)
Ingrid Daubechies, Orthonormal bases of compactly supported wavelets Communications on Pure and Applied Mathematics. ,vol. 41, pp. 909- 996 ,(1988) , 10.1002/CPA.3160410705
G. Cybenko, Approximation by superpositions of a sigmoidal function Mathematics of Control, Signals, and Systems. ,vol. 2, pp. 303- 314 ,(1989) , 10.1007/BF02551274
Q. Zhang, A. Benveniste, Approximation by nonlinear wavelet networks international conference on acoustics, speech, and signal processing. pp. 3417- 3420 ,(1991) , 10.1109/ICASSP.1991.150188