Stochastic Attribute Selection Committees

作者: Zijian Zheng , Geoffrey I. Webb

DOI: 10.1007/BFB0095063

关键词:

摘要: Classifier committee learning methods generate multiple classifiers to form a by repeated application of single base algorithm. The members vote decide the final classification. Two such methods, Bagging and Boosting, have shown great success with decision tree learning. They create different modifying distribution training set. This paper studies approach: Stochastic Attribute Selection Committee trees. It generates classifier committees stochastically set attributes but keeping unchanged. An empirical evaluation variant this method, namely Sasc, in representative collection natural domains shows that SASC method can significantly reduce error rate On average Sasc is more accurate than less although one-tailed sign-test fails show these differences are significant at level 0.05. In addition, it found that, like Bagging, stable Boosting terms frequently obtaining higher rates C4.5 and, when raised, producing lower increases. Moreover, amenable parallel distributed processing while not.

参考文章(19)
David H. Wolpert, Original Contribution: Stacked generalization Neural Networks. ,vol. 5, pp. 241- 259 ,(1992) , 10.1016/S0893-6080(05)80023-1
Suk Wah Kwok, Chris Carter, Multiple decision trees uncertainty in artificial intelligence. ,vol. 9, pp. 327- 338 ,(1990) , 10.1016/B978-0-444-88650-7.50030-5
Thomas G. Dietterich, Machine-Learning Research Ai Magazine. ,vol. 18, pp. 97- 136 ,(1997) , 10.1609/AIMAG.V18I4.1324
Robert E. Schapire, Yoav Freund, Wee Sun Lee, Peter Barlett, Boosting the margin: A new explanation for the effectiveness of voting methods international conference on machine learning. pp. 322- 330 ,(1997)
Zijian Zheng, Naive Bayesian Classifier Committees european conference on machine learning. pp. 196- 207 ,(1998) , 10.1007/BFB0026690
Ron Kohavi, Clayton Kunz, Option Decision Trees with Majority Votes international conference on machine learning. pp. 161- 169 ,(1997)
Michael J. Pazzani, Kamal Mahmood Ali, Learning probabilistic relational concept descriptions University of California, Irvine. ,(1996)
T. G. Dietterich, G. Bakiri, Solving multiclass learning problems via error-correcting output codes Journal of Artificial Intelligence Research. ,vol. 2, pp. 263- 286 ,(1994) , 10.1613/JAIR.105
J. R. Quinlan, Bagging, boosting, and C4.S national conference on artificial intelligence. pp. 725- 730 ,(1996)
KAGAN TUMER, JOYDEEP GHOSH, Error Correlation and Error Reduction in Ensemble Classifiers Connection Science. ,vol. 8, pp. 385- 404 ,(1996) , 10.1080/095400996116839