Double-bagging: combining classifiers by bootstrap aggregation

作者: Torsten Hothorn , Berthold Lausen

DOI: 10.1016/S0031-3203(02)00169-3

关键词:

摘要: The combination of classifiers leads to substantial reduction misclassification error in a wide range applications and benchmark problems. We suggest using an out-of-bag sample for combining different classifiers. In our setup, linear discriminant analysis is performed the observations sample, corresponding variables computed bootstrap are used as additional predictors classification tree. Two combined therefore method variable selection bias no problem estimate error, need test disappears. Moreover, procedure performs comparable best number artificial examples applications.

参考文章(27)
Leo Breiman, OUT-OF-BAG ESTIMATION ,(1996)
David H. Wolpert, William G. Macready, An Efficient Method To Estimate Bagging‘s Generalization Error Machine Learning. ,vol. 35, pp. 41- 55 ,(1999) , 10.1023/A:1007519102914
Marina Skurichina, Robert P. W. Duin, The Role of Combining Rules in Bagging and Boosting Lecture Notes in Computer Science. pp. 631- 640 ,(2000) , 10.1007/3-540-44522-6_65
Frederick S. Mikelberg, Nicholas V. Swindale, Adeline Chin, Gordana Stjepanovic, Automated Analysis of Normal and Glaucomatous Optic Nerve Head Topography Images Investigative Ophthalmology & Visual Science. ,vol. 41, pp. 1730- 1742 ,(2000)
Richard A Olshen, Charles J Stone, Leo Breiman, Jerome H Friedman, Classification and regression trees ,(1983)
Christopher J Merz, None, Using Correspondence Analysis to Combine Classifiers Machine Learning. ,vol. 36, pp. 33- 58 ,(1999) , 10.1023/A:1007559205422
Jerome H. Friedman, On Bias, Variance, 0/1—Loss, and the Curse-of-Dimensionality Data Mining and Knowledge Discovery. ,vol. 1, pp. 55- 77 ,(1997) , 10.1023/A:1009778005914
Ross Ihaka, Robert Gentleman, R: A Language for Data Analysis and Graphics Journal of Computational and Graphical Statistics. ,vol. 5, pp. 299- 314 ,(1996) , 10.1080/10618600.1996.10474713
Robert E. Schapire, Yoav Freund, Peter Bartlett, Wee Sun Lee, Boosting the margin: a new explanation for the effectiveness of voting methods Annals of Statistics. ,vol. 26, pp. 1651- 1686 ,(1998) , 10.1214/AOS/1024691352