Simplified neural networks for solving linear least squares and total least squares problems in real time

作者: A. Cichocki , R. Unbehauen

DOI: 10.1109/72.329687

关键词: Computer scienceArtificial neural networkAdaptive algorithmNon-linear iterative partial least squaresIteratively reweighted least squaresAlgebraic equationLinear least squaresLinear regressionRecursive least squares filterTotal least squaresAlgorithmLeast squares support vector machineNon-linear least squaresLinear systemLeast squares

摘要: In this paper a new class of simplified low-cost analog artificial neural networks with on chip adaptive learning algorithms are proposed for solving linear systems algebraic equations in real time. The least squares (LS), total (TLS) and data (DLS) problems can be considered as modifications extensions well known algorithms: the row-action projection-Kaczmarz algorithm and/or LMS (Adaline) Widrow-Hoff algorithms. applied to any problem which formulated regression problem. correctness high performance illustrated by extensive computer simulation results. >

参考文章(26)
Rolf Unbehauen, Andrzej Cichocki, MOS Switched-Capacitor and Continuous-Time Integrated Circuits and Systems Springer Berlin Heidelberg. ,(1989) , 10.1007/978-3-642-83677-0
Lei Xu, Erkki Oja, Ching Y. Suen, Modified Hebbian learning for curve and surface fitting Neural Networks. ,vol. 5, pp. 441- 457 ,(1992) , 10.1016/0893-6080(92)90006-5
J. Mandel, W. L. Miranker, New techniques for fast hybrid solutions of systems of equations International Journal for Numerical Methods in Engineering. ,vol. 27, pp. 455- 467 ,(1989) , 10.1002/NME.1620270303
Dianne P. O’Leary, Robust regression computation computation using iteratively reweighted least squares SIAM Journal on Matrix Analysis and Applications. ,vol. 11, pp. 466- 480 ,(1990) , 10.1137/0611032
M. Forti, S. Manetti, M. Marini, Neural network for adaptive FIR filtering Electronics Letters. ,vol. 26, pp. 1018- 1019 ,(1990) , 10.1049/EL:19900659
K. S. Arun, A unitarily constrained total least squares problem in signal processing SIAM Journal on Matrix Analysis and Applications. ,vol. 13, pp. 729- 745 ,(1992) , 10.1137/0613046
Gene H. Golub, Charles F. van Loan, An Analysis of the Total Least Squares Problem SIAM Journal on Numerical Analysis. ,vol. 17, pp. 883- 893 ,(1980) , 10.1137/0717073
Martin Hanke, Wilhelm Niethammer, On the acceleration of Kaczmarz's method for inconsistent linear systems Linear Algebra and its Applications. ,vol. 130, pp. 83- 98 ,(1990) , 10.1016/0024-3795(90)90207-S
Subramania I. Sudharsanan, Malur K. Sundareshan, Exponential stability and a systematic synthesis of a neural network for quadratic minimization Neural Networks. ,vol. 4, pp. 599- 613 ,(1991) , 10.1016/0893-6080(91)90014-V
A.D. Culhane, M.C. Peckerar, C.R.K. Marrian, A neural net approach to discrete Hartley and Fourier transforms IEEE Transactions on Circuits and Systems. ,vol. 36, pp. 695- 703 ,(1989) , 10.1109/31.31318