The optimised internal representation of multilayered classifier networks performs nonlinear discriminant analysis

作者: Andrew R Webb , David Lowe

DOI: 10.1016/0893-6080(90)90019-H

关键词:

摘要: Abstract This paper illustrates why a nonlinear adaptive feed-forward layered network with linear output units can perform well as pattern classification device. The central result is that minimising the error at of equivalent to maximising particular norm, discriminant function, hidden units. first part explicitly performing transformation data into space in which classes may be more easily separated. specific nature this constrained maximise function. If targets are appropriately chosen, function relates pseudo-inverse total covariance matrix and weighted between-class unit patterns. Numerical simulations presented illustrate results.

参考文章(18)
David Lowe, David S. Broomhead, Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks Complex Systems. ,vol. 2, pp. 321- 355 ,(1988)
Tzay Y. Young, Thomas W. Calvert, Classification, estimation, and pattern recognition American Elsevier. ,(1974)
D. Lowe, Adaptive radial basis function nonlinearities, and the problem of generalisation international conference on artificial neural networks. pp. 171- 175 ,(1989)
R.Paul Gorman, Terrence J. Sejnowski, Analysis of Hidden Units in a Layered Network Trained to Classify Sonar Targets Neural Networks. ,vol. 1, pp. 75- 89 ,(1988) , 10.1016/0893-6080(88)90023-8
G. Golub, W. Kahan, Calculating the Singular Values and Pseudo-Inverse of a Matrix Journal of The Society for Industrial and Applied Mathematics, Series B: Numerical Analysis. ,vol. 2, pp. 205- 224 ,(1965) , 10.1137/0702016
H. Bourlard, Y. Kamp, Auto-association by multilayer perceptrons and singular value decomposition Biological Cybernetics. ,vol. 59, pp. 291- 294 ,(1988) , 10.1007/BF00332918
C. G. Broyden, Quasi-Newton methods and their application to function minimisation Mathematics of Computation. ,vol. 21, pp. 368- 381 ,(1967) , 10.1090/S0025-5718-1967-0224273-2