Online and batch learning of pseudo-metrics

作者: Shai Shalev-Shwartz , Yoram Singer , Andrew Y. Ng

DOI: 10.1145/1015330.1015376

关键词:

摘要: We describe and analyze an online algorithm for supervised learning of pseudo-metrics. The receives pairs instances predicts their similarity according to a pseudo-metric. pseudo-metrics we use are quadratic forms parameterized by positive semi-definite matrices. core the is update rule that based on successive projections onto cone half-space constraints imposed examples. efficient procedure performing these projections, derive worst case mistake bound predictions, discuss dual version in which it simple incorporate kernel operators. also serves as building block deriving large-margin batch algorithm. demonstrate merits proposed approach conducting experiments MNIST dataset document filtering.

参考文章(15)
Yair Al Censor, Stavros A. Zenios, Parallel Optimization: Theory, Algorithms, and Applications ,(1997)
Ralf Herbrich, Hugo Zaragoza, Yaoyong Li, John Shawe-Taylor, Jaz S. Kandola, The Perceptron Algorithm with Uneven Margins international conference on machine learning. pp. 379- 386 ,(2002)
Mark Herbster, Learning Additive Models Online with Fast Evaluating Kernels european conference on computational learning theory. pp. 444- 460 ,(2001) , 10.1007/3-540-44581-1_29
Noam Shental, Tomer Hertz, Daphna Weinshall, Misha Pavel, Adjustment Learning and Relevant Component Analysis european conference on computer vision. pp. 776- 792 ,(2002) , 10.1007/3-540-47979-1_52
Amit Singhal, Chris Buckley, Manclar Mitra, Pivoted document length normalization international acm sigir conference on research and development in information retrieval. ,vol. 51, pp. 21- 29 ,(1996) , 10.1145/3130348.3130365
Pat Langley, Editorial: On Machine Learning Machine Learning. ,vol. 1, pp. 5- 10 ,(1986) , 10.1023/A:1022687019898
Eric Xing, Michael Jordan, Stuart J Russell, Andrew Ng, None, Distance Metric Learning with Application to Clustering with Side-Information neural information processing systems. ,vol. 15, pp. 521- 528 ,(2002)
T. Cover, P. Hart, Nearest neighbor pattern classification IEEE Transactions on Information Theory. ,vol. 13, pp. 21- 27 ,(1967) , 10.1109/TIT.1967.1053964
Vladimir Naumovich Vapnik, Vlamimir Vapnik, Statistical learning theory John Wiley & Sons. ,(1998)