Pruning and Exclusion Criteria for Unordered Incremental Reduced Error Pruning

作者: Henrik Boström

DOI:

关键词:

摘要: Incremental reduced error pruning is a technique that has been extensively used for efficient induction of ordered rule sets (decision lists). Several criteria have developed regarding how to prune rules and whether or not exclude generated rules. A version incremental unordered presented, the appropriateness previously proposed novel investigated. It shown when inducing sets, where Bayesian framework combine predictions from multiple rules, could lead exclusion possibly beneficial as well inclusion harmful Two alternative are introduced, one based on likelihood ratio margin. An empirical evaluation 34 datasets shows significantly outperform employed using margin-based being slightly ahead criterion.

参考文章(19)
William W. Cohen, Efficient Pruning Methods for Separate-and-Conquer Rule Learning Systems. international joint conference on artificial intelligence. pp. 988- 994 ,(1993)
Bojan Cestnik, Estimating probabilities: a crucial task in machine learning european conference on artificial intelligence. pp. 147- 149 ,(1990)
Martin Eineborg, Henrik Boström, Classifying Uncovered Examples by Rule Stretching inductive logic programming. pp. 41- 50 ,(2001) , 10.1007/3-540-44797-0_4
Ian H. Witten, Eibe Frank, Generating Accurate Rule Sets Without Global Optimization international conference on machine learning. pp. 144- 151 ,(1998)
Johannes Fürnkranz, Peter A. Flach, An analysis of rule evaluation metrics international conference on machine learning. pp. 202- 209 ,(2003)
William W. Cohen, Fast Effective Rule Induction Machine Learning Proceedings 1995. pp. 115- 123 ,(1995) , 10.1016/B978-1-55860-377-6.50023-2
Johannes Fürnkranz, Separate-and-Conquer Rule Learning Artificial Intelligence Review. ,vol. 13, pp. 3- 54 ,(1999) , 10.1023/A:1006524209794
Tony Lindgren, Henrik Boström, Resolving Rule Conflicts with Double Induction Advances in Intelligent Data Analysis V. ,vol. 8, pp. 60- 67 ,(2003) , 10.1007/978-3-540-45231-7_6
Peter Clark, Robin Boswell, Rule induction with CN2: Some recent improvements Lecture Notes in Computer Science. pp. 151- 163 ,(1991) , 10.1007/BFB0017011
Robert E. Schapire, Yoav Freund, Peter Bartlett, Wee Sun Lee, Boosting the margin: a new explanation for the effectiveness of voting methods Annals of Statistics. ,vol. 26, pp. 1651- 1686 ,(1998) , 10.1214/AOS/1024691352