Ranking and Empirical Minimization of U-statistics

作者: Stéphan Clémençon , Gábor Lugosi , Nicolas Vayatis

DOI: 10.1214/009052607000000910

关键词:

摘要: The problem of ranking/ordering instances, instead simply classifying them, has recently gained much attention in machine learning. In this paper we formulate the ranking a rigorous statistical framework. goal is to learn rule for deciding, among two which one "better," with minimum risk. Since natural estimates risk are form U-statistic, results theory U-processes required investigating consistency empirical minimizers. We establish particular tail inequality degenerate U-processes, and apply it showing that fast rates convergence may be achieved under specific noise assumptions, just like classification. Convex minimization methods also studied.

参考文章(39)
Christian Houdré, Patricia Reynaud-Bouret, Exponential Inequalities, with Constants, for U-statistics of Order Two Birkhäuser, Basel. pp. 55- 69 ,(2003) , 10.1007/978-3-0348-8069-5_5
Nicolas Usunier, Massih-Reza Amini, Tuong Vinh Truong, Patrick Gallinari, Ranking with Unlabeled Data: A First Study neural information processing systems. pp. 24- 28 ,(2005)
G. Lugosi, Pattern Classification and Learning Theory Principles of Nonparametric Learning. pp. 1- 56 ,(2002) , 10.1007/978-3-7091-2568-7_1
Cynthia Rudin, Ranking with a P-Norm Push Learning Theory. pp. 589- 604 ,(2006) , 10.1007/11776420_43
Evarist Giné, Victor de la Peña, De La Pena .G, Decoupling: From Dependence to Independence ,(1998)
László Györfi, Luc Devroye, Gábor Lugosi, A Probabilistic Theory of Pattern Recognition ,(1996)
D. Panchenko, V. Koltchinskii, Empirical margin distributions and bounding the generalization error of combined classifiers Annals of Statistics. ,vol. 30, pp. 1- 50 ,(2002) , 10.1214/AOS/1015362183
Ingo Steinwart, On the influence of the kernel on the consistency of support vector machines Journal of Machine Learning Research. ,vol. 2, pp. 67- 93 ,(2002) , 10.1162/153244302760185252
John Arthur Swets, David Marvin Green, Signal Detection Theory and Psychophysics ,(1974)