Learning neighborhoods for metric learning

作者: Jun Wang , Adam Woznica , Alexandros Kalousis

DOI: 10.1007/978-3-642-33460-3_20

关键词: MathematicsInstance-based learningUnsupervised learningLarge margin nearest neighborSemi-supervised learningArtificial intelligenceMulti-task learningMachine learningAlgorithmic learning theoryActive learning (machine learning)Metric (mathematics)

摘要: Metric learning methods have been shown to perform well on different tasks. Many of them rely target neighborhood relationships that are computed in the original feature space and remain fixed throughout learning. As a result, learned metric reflects relations. We propose novel formulation problem which, addition metric, relations also two-step iterative approach. The new can be seen as generalization many existing methods. includes neighbor assignment rule assigns numbers neighbors instances according their quality; 'high quality' get more neighbors. experiment with two its instantiations correspond algorithms LMNN MCML compare it other number datasets. experimental results show state-of-the-art performance provide evidence does improve predictive performance.

参考文章(21)
Zhirong Yang, Jorma Laaksonen, Regularized neighborhood component analysis scandinavian conference on image analysis. pp. 253- 262 ,(2007) , 10.1007/978-3-540-73040-8_26
James C. Bezdek, Richard J. Hathaway, Some Notes on Alternating Optimization soft computing. pp. 288- 300 ,(2002) , 10.1007/3-540-45631-7_39
Nam Nguyen, Yunsong Guo, Metric Learning: A Support Vector Approach european conference on machine learning. pp. 125- 136 ,(2008) , 10.1007/978-3-540-87481-2_9
Gautam Appa, Gerard Sierksma, Linear and integer programming; Theory and practice The Mathematical Gazette. ,vol. 83, pp. 560- 561 ,(1999) , 10.2307/3621017
Alexander Schrijver, Theory of Linear and Integer Programming ,(1986)
Alexandros Kalousis, Julien Prados, Melanie Hilario, Stability of feature selection algorithms: a study on high-dimensional spaces Knowledge and Information Systems. ,vol. 12, pp. 95- 116 ,(2007) , 10.1007/S10115-006-0040-8
Sam T Roweis, Lawrence K Saul, Nonlinear Dimensionality Reduction by Locally Linear Embedding Science. ,vol. 290, pp. 2323- 2326 ,(2000) , 10.1126/SCIENCE.290.5500.2323
Zhengdong Lu, Prateek Jain, Inderjit S. Dhillon, Geometry-aware metric learning Proceedings of the 26th Annual International Conference on Machine Learning - ICML '09. pp. 673- 680 ,(2009) , 10.1145/1553374.1553461
Amir Globerson, Sam T. Roweis, Metric Learning by Collapsing Classes neural information processing systems. ,vol. 18, pp. 451- 458 ,(2005)
Kilian Q. Weinberger, Lawrence K. Saul, Distance Metric Learning for Large Margin Nearest Neighbor Classification Journal of Machine Learning Research. ,vol. 10, pp. 207- 244 ,(2009) , 10.5555/1577069.1577078