Switching class labels to generate classification ensembles

作者: Gonzalo Martínez-Muñoz , Alberto Suárez

DOI: 10.1016/J.PATCOG.2005.02.020

关键词:

摘要: Ensembles that combine the decisions of classifiers generated by using perturbed versions training set where classes examples are randomly switched can produce a significant error reduction, provided large numbers units and high class switching rates used. The this procedure have statistically uncorrelated errors in set. Hence, ensembles they form exhibit similar dependence on ensemble size, independently classification problem. In particular, for binary problems, performance data be analysed terms Bernoulli process. Experiments several UCI datasets demonstrate improvements accuracy obtained these class-switching ensembles.

参考文章(21)
Leo Breiman, Randomizing Outputs to Increase Prediction Accuracy Machine Learning. ,vol. 40, pp. 229- 242 ,(2000) , 10.1023/A:1007682208299
Richard A Olshen, Charles J Stone, Leo Breiman, Jerome H Friedman, Classification and regression trees ,(1983)
J. R. Quinlan, Improved use of continuous attributes in C4.5 Journal of Artificial Intelligence Research. ,vol. 4, pp. 77- 90 ,(1996) , 10.1613/JAIR.279
J. R. Quinlan, Bagging, boosting, and C4.S national conference on artificial intelligence. pp. 725- 730 ,(1996)
Robert E. Schapire, Yoav Freund, Peter Bartlett, Wee Sun Lee, Boosting the margin: a new explanation for the effectiveness of voting methods Annals of Statistics. ,vol. 26, pp. 1651- 1686 ,(1998) , 10.1214/AOS/1024691352
Yoav Freund, Robert E Schapire, A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting conference on learning theory. ,vol. 55, pp. 119- 139 ,(1997) , 10.1006/JCSS.1997.1504
Marina Skurichina, Robert P.W. Duin, BAGGING FOR LINEAR CLASSIFIERS Pattern Recognition. ,vol. 31, pp. 909- 930 ,(1998) , 10.1016/S0031-3203(97)00110-6
Leo Breiman, Arcing classifier (with discussion and a rejoinder by the author) Annals of Statistics. ,vol. 26, pp. 801- 849 ,(1998) , 10.1214/AOS/1024691079
Torsten Hothorn, Berthold Lausen, Double-bagging: combining classifiers by bootstrap aggregation Pattern Recognition. ,vol. 36, pp. 1303- 1309 ,(2003) , 10.1016/S0031-3203(02)00169-3