Optimal discriminant plane for a small number of samples and design method of classifier on the plane

作者: Zi-Quan Hong , Jing-Yu Yang

DOI: 10.1016/0031-3203(91)90074-F

关键词: Singular value decompositionDiscriminantSingular valueOptimal discriminant analysisGeneralized eigenvectorScatter matrixMathematicsMatrix (mathematics)Applied mathematicsEigenvalues and eigenvectorsCombinatorics

摘要: Abstract In a previous work (Zi-Quan Hong and Jing-Yu Yang, Minimum distance classifier on the optimal discriminant plane), we suggested derived method for constructing plane using minimum criteria. this paper, problem of solving small number samples is discussed, which based above paper by same authors. case samples, generalized eigenequation AX = λBX established large usually has no solution because within-class scatter matrix singular. To obtain eigenequation, new suggested, in Singular Value Perturbation added to such that becomes nonsingular matrix. Therefore, can be solved existing algorithms. We proved eigenequations are stable respect eigenvalues eigenvectors indeed directions, if perturbation subject some certain conditions. The experimental results have shown our works well constructed with high performance even samples.

参考文章(8)
Roger S. Martin, J. H. Wilkinson, Similarity reduction of a general matrix to Hessenberg form Numerische Mathematik. ,vol. 12, pp. 349- 368 ,(1968) , 10.1007/BF02161358
D.H. Foley, J.W Sammon, An Optimal Set of Discriminant Vectors IEEE Transactions on Computers. ,vol. 24, pp. 281- 289 ,(1975) , 10.1109/T-C.1975.224208
G. Peters, J. H. Wilkinson, $Ax = \lambda Bx$ and the Generalized Eigenproblem SIAM Journal on Numerical Analysis. ,vol. 7, pp. 479- 492 ,(1970) , 10.1137/0707039
R. A. FISHER, THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS Annals of Human Genetics. ,vol. 7, pp. 179- 188 ,(1936) , 10.1111/J.1469-1809.1936.TB02137.X
Wojciech Siedlecki, Kinga Siedlecka, Jack Sklansky, An overview of mapping techniques for exploratory pattern analysis Pattern Recognition. ,vol. 21, pp. 411- 429 ,(1988) , 10.1016/0031-3203(88)90001-5
J.W. Sammon, An Optimal Discriminant Plane IEEE Transactions on Computers. ,vol. C-19, pp. 826- 829 ,(1970) , 10.1109/T-C.1970.223047
G. Peters, J. H. Wilkinson, Eigenvectors of real and complex matrices byLR andQR triangularizations Numerische Mathematik. ,vol. 16, pp. 181- 204 ,(1970) , 10.1007/BF02219772