Similarity Learning for Nearest Neighbor Classification

作者: Ali Mustafa Qamar , Eric Gaussier , Jean-Pierre Chevallet , Joo Hwee Lim

DOI: 10.1109/ICDM.2008.81

关键词: Class (biology)k-nearest neighbors algorithmPerceptronSimilarity (network science)Pattern recognitionMathematicsSymmetric matrixJaccard indexArtificial intelligenceEuclidean distanceSimilarity learning

摘要: In this paper, we propose an algorithm for learning a general class of similarity measures kNN classification. This encompasses, among others, the standard cosine measure, as well Dice and Jaccard coefficients. The is extension voted perceptron allows one to learn different types functions (either based on diagonal, symmetric or asymmetric matrices). results obtained show that yields significant improvements several collections, two prediction rules: rule, which was our primary goal, version it.

参考文章(14)
Michał Grabowski, Andrzej Szałas, A Technique for Learning Similarities on Complex Structures with Applications to Extracting Ontologies Advances in Web Intelligence. pp. 183- 189 ,(2005) , 10.1007/11495772_29
D.P. Helmbold, M.K. Warmuth, On Weak Learning Journal of Computer and System Sciences. ,vol. 50, pp. 551- 573 ,(1995) , 10.1006/JCSS.1995.1044
Yoav Freund, Robert E. Schapire, Large margin classification using the perceptron algorithm conference on learning theory. ,vol. 37, pp. 209- 217 ,(1998) , 10.1145/279943.279985
Shai Shalev-Shwartz, Yoram Singer, Andrew Y. Ng, Online and batch learning of pseudo-metrics Twenty-first international conference on Machine learning - ICML '04. pp. 94- ,(2004) , 10.1145/1015330.1015376
Li Baoli, Lu Qin, Yu Shiwen, An adaptive k-nearest neighbor text categorization strategy ACM Transactions on Asian Language Information Processing. ,vol. 3, pp. 215- 226 ,(2004) , 10.1145/1039621.1039623
Amir Globerson, Sam T. Roweis, Metric Learning by Collapsing Classes neural information processing systems. ,vol. 18, pp. 451- 458 ,(2005)
RICHARD NOCK, MARC SEBBAN, DIDIER BERNARD, A SIMPLE LOCALLY ADAPTIVE NEAREST NEIGHBOR RULE WITH APPLICATION TO POLLUTION FORECASTING International Journal of Pattern Recognition and Artificial Intelligence. ,vol. 17, pp. 1369- 1382 ,(2003) , 10.1142/S0218001403002952
Kilian Q. Weinberger, John Blitzer, Lawrence K. Saul, Distance Metric Learning for Large Margin Nearest Neighbor Classification neural information processing systems. ,vol. 18, pp. 1473- 1480 ,(2005)
Jun-Peng Bao, Jun-Yi Shen, Xiao-Domg Liu, Hai-Yan Liu, Quick asymmetric text similarity measures international conference on machine learning and cybernetics. ,vol. 1, pp. 374- 379 ,(2003) , 10.1109/ICMLC.2003.1264505