Sensitive error correcting output codes

作者: John Langford , Alina Beygelzimer

DOI: 10.1007/11503415_11

关键词:

摘要: We present a reduction from cost-sensitive classification to binary based on (a modification of) error correcting output codes. The satisfies the property that e regret for implies l2-regret of at most 2e cost estimation. This has several implications: Any regret-minimizing online algorithm 0/1 loss is (via reduction) algorithm. In particular, this means learning can be made work arbitrary (i.e., totally unstructured) functions. The thresholded so 4${\sqrt{\epsilon Z}}$ where Z expected sum costs. For multiclass problems, translates into 4e in estimation class probabilities. For classification, 4${\sqrt{\epsilon}}$ regret.

参考文章(17)
Bianca Zadrozny, John Langford, Estimating Class Membership Probabilities using Classifier Learners. international conference on artificial intelligence and statistics. ,(2005)
Alina Beygelzimer, Thomas P. Hayes, John Langford, Varsha Dani, Reductions Between Classification Tasks Electronic Colloquium on Computational Complexity. ,(2004)
OL Mangasarian, A Smola, P Bartlett, B Schölkopf, D Schuurmans, Advances in Large Margin Classifiers MIT Press. ,(2000)
T. G. Dietterich, G. Bakiri, Solving multiclass learning problems via error-correcting output codes Journal of Artificial Intelligence Research. ,vol. 2, pp. 263- 286 ,(1994) , 10.1613/JAIR.105
L. G. Valiant, Learning disjunction of conjunctions international joint conference on artificial intelligence. pp. 560- 566 ,(1985)
Venkatesan Guruswami, Amit Sahai, Multiclass learning, boosting, and error-correcting codes conference on learning theory. pp. 145- 155 ,(1999) , 10.1145/307400.307429
Adam Kalai, Rocco A. Servedio, Boosting in the presence of noise symposium on the theory of computing. pp. 195- 205 ,(2003) , 10.1145/780542.780573
Yoav Freund, Robert E Schapire, A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting conference on learning theory. ,vol. 55, pp. 119- 139 ,(1997) , 10.1006/JCSS.1997.1504
V. N. Vapnik, A. Ya. Chervonenkis, On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities Measures of Complexity. ,vol. 16, pp. 11- 30 ,(2015) , 10.1007/978-3-319-21852-6_3