Probability Estimation for Multi-class Classification Based on Label Ranking

作者: Weiwei Cheng , Eyke Hüllermeier

DOI: 10.1007/978-3-642-33486-3_6

关键词: Pairwise comparisonBrier scoreMathematicsBasis (linear algebra)Context (language use)Multinomial distributionArtificial intelligenceRanking SVMData miningMachine learningMulticlass classificationRanking (information retrieval)

摘要: We consider the problem of probability estimation in setting multi-class classification. While this has already been addressed literature, we tackle it from a novel perspective. Exploiting close connection between and ranking, our idea is to solve former on basis latter, taking advantage recently developed methods for label ranking. More specifically, argue that Plackett-Luce ranking model very natural choice context, especially as can be seen multinomial extension Bradley-Terry model. The latter provides pairwise coupling techniques, which arguably constitute state-of-the-art estimation. explore relationship ranking-based approach estimation, both formally empirically. Using synthetic real-world data, show method does not only enjoy nice theoretical properties, but also competitive terms accuracy efficiency.

参考文章(31)
R. L. Plackett, The Analysis of Permutations Journal of The Royal Statistical Society Series C-applied Statistics. ,vol. 24, pp. 193- 202 ,(1975) , 10.2307/2346567
Peter A. Flach, Putting Things in Order: On the Fundamental Role of Ranking in Classification and Probability Estimation european conference on principles of data mining and knowledge discovery. pp. 2- 3 ,(2007) , 10.1007/978-3-540-74976-9_2
Ting-Fan Wu, Chih-Jen Lin, Ruby Weng, None, Probability Estimates for Multi-class Classification by Pairwise Coupling Journal of Machine Learning Research. ,vol. 5, pp. 975- 1005 ,(2004) , 10.5555/1005332.1016791
Krzysztof J. Dembczynski, Krzysztof J. Dembczynski, Weiwei Cheng, Eyke H llermeier, Label Ranking Methods based on the Plackett-Luce Model international conference on machine learning. pp. 215- 222 ,(2010)
Michael P. Wellman, Some Varieties of Qualitative Probability international conference information processing. pp. 171- 179 ,(1994) , 10.1007/BFB0035948
Bianca Zadrozny, Charles Elkan, Learning and making decisions when costs and probabilities are both unknown knowledge discovery and data mining. pp. 204- 213 ,(2001) , 10.1145/502512.502540
John I Marden, Analyzing and Modeling Rank Data ,(1996)
Stéphan Clémençon, Gábor Lugosi, Nicolas Vayatis, Ranking and Empirical Minimization of U-statistics Annals of Statistics. ,vol. 36, pp. 844- 874 ,(2008) , 10.1214/009052607000000910
Bianca Zadrozny, Charles Elkan, Transforming classifier scores into accurate multiclass probability estimates Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '02. pp. 694- 699 ,(2002) , 10.1145/775047.775151