Rule extraction from ensemble methods using aggregated decision trees

作者: Md. Ridwan Al Iqbal

DOI: 10.1007/978-3-642-34481-7_73

关键词:

摘要: Ensemble methods have become very well known for being powerful pattern recognition algorithms capable of achieving high accuracy. However, produces learners that are not comprehensible or transferable thus making them unsuitable tasks require a rational justification decision. Rule Extraction can resolve this limitation by extracting rules from trained ensembles classifiers. In paper, we present an algorithm called REEMTIC uses symbolic learning (Decision Tree) on each underlying classifier the ensemble and combines them. Experiments theoretical analysis show generates highly accurate closely approximates Learned Model.

参考文章(17)
Richi Nayak, GYAN: A methodology for rule extraction from artificial neural networks Queensland University of Technology. ,(1999)
Michael J. Pazzani, Clifford A. Brunk, Glenn Silverstein, A knowledge-intensive approach to learning relational concepts Machine Learning Proceedings 1991. pp. 432- 436 ,(1991) , 10.1016/B978-1-55860-200-7.50089-1
Ashish Darbari, Rule Extraction from Trained ANN: A Survey s.n.. ,(2000)
Mark W. Craven, Jude W. Shavlik, Using Sampling and Queries to Extract Rules from Trained Neural Networks Machine Learning Proceedings 1994. pp. 37- 45 ,(1994) , 10.1016/B978-1-55860-335-6.50013-1
Jerome Friedman, Trevor Hastie, Robert Tibshirani, Additive logistic regression: a statistical view of boosting (With discussion and a rejoinder by the authors) Annals of Statistics. ,vol. 28, pp. 337- 407 ,(2000) , 10.1214/AOS/1016218223
Robert Andrews, Joachim Diederich, Alan B. Tickle, Survey and critique of techniques for extracting rules from trained artificial neural networks Knowledge Based Systems. ,vol. 8, pp. 373- 389 ,(1995) , 10.1016/0950-7051(96)81920-4
Sherif Hashem, Optimal linear combinations of neural networks Neural Networks. ,vol. 10, pp. 599- 614 ,(1997) , 10.1016/S0893-6080(96)00098-6
Richard Maclin, David Opitz, Popular ensemble methods: an empirical study Journal of Artificial Intelligence Research. ,vol. 11, pp. 169- 198 ,(1999) , 10.1613/JAIR.614
Alberto L. Sangiovanni-Vincentelli, Gary D. Hachtel, Curtis T. McMullen, Robert King Brayton, Logic Minimization Algorithms for VLSI Synthesis ,(1984)
Robert E. Schapire, Yoav Freund, Experiments with a new boosting algorithm international conference on machine learning. pp. 148- 156 ,(1996)