Optimal dimensionality of metric space for classification

作者: Wei Zhang , Xiangyang Xue , Zichen Sun , Yue-Fei Guo , Hong Lu

DOI: 10.1145/1273496.1273639

关键词: Mathematical optimizationDimensionality reductionEmbeddingArtificial intelligenceMathematicsMetric (mathematics)Fisher information metricPattern recognitionCurse of dimensionalityMetric spaceEuclidean distanceDiscriminant

摘要: In many real-world applications, Euclidean distance in the original space is not good due to curse of dimensionality. this paper, we propose a new method, called Discriminant Neighborhood Embedding (DNE), learn an appropriate metric for classification given finite training samples. We define discriminant adjacent matrix favor task, i.e., neighboring samples same class are squeezed but those different classes separated as far possible. The optimal dimensionality can be estimated by spectral analysis proposed which great significance high-dimensional patterns. Experiments with various datasets demonstrate effectiveness our method.

参考文章(19)
Xipeng Qiu, Lide Wu, Stepwise nearest neighbor discriminant analysis international joint conference on artificial intelligence. pp. 829- 834 ,(2005)
Daniel B. Graham, Nigel M. Allinson, Characterising Virtual Eigensignatures for General Purpose Face Recognition NATO-ASI on Face Recognition : From Theory to Applications. pp. 446- 456 ,(1998) , 10.1007/978-3-642-72201-1_25
Keinosuke Fukunaga, Introduction to statistical pattern recognition (2nd ed.) Academic Press Professional, Inc.. ,(1990)
Joshua B Tenenbaum, Vin de Silva, John C Langford, A Global Geometric Framework for Nonlinear Dimensionality Reduction Science. ,vol. 290, pp. 2319- 2323 ,(2000) , 10.1126/SCIENCE.290.5500.2319
Sam T Roweis, Lawrence K Saul, Nonlinear Dimensionality Reduction by Locally Linear Embedding Science. ,vol. 290, pp. 2323- 2326 ,(2000) , 10.1126/SCIENCE.290.5500.2323
T. Hastie, R. Tibshirani, Discriminant adaptive nearest neighbor classification IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 18, pp. 607- 616 ,(1996) , 10.1109/34.506411
Masashi Sugiyama, Local Fisher discriminant analysis for supervised dimensionality reduction Proceedings of the 23rd international conference on Machine learning - ICML '06. pp. 905- 912 ,(2006) , 10.1145/1143844.1143958
Eric Xing, Michael Jordan, Stuart J Russell, Andrew Ng, None, Distance Metric Learning with Application to Clustering with Side-Information neural information processing systems. ,vol. 15, pp. 521- 528 ,(2002)
Xiaofei He, Shuicheng Yan, Yuxiao Hu, P. Niyogi, Hong-Jiang Zhang, Face recognition using Laplacianfaces IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 27, pp. 328- 340 ,(2005) , 10.1109/TPAMI.2005.55
P.N. Belhumeur, J.P. Hespanha, D.J. Kriegman, Eigenfaces vs. Fisherfaces: recognition using class specific linear projection IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 19, pp. 711- 720 ,(1997) , 10.1109/34.598228