Rule induction and instance-based learning a unified approach

作者: Pedro Domingos

DOI:

关键词: SIMPLE algorithmMachine learningSet (abstract data type)MathematicsRule inductionEmpirical researchTest (assessment)Artificial intelligenceInstance-based learning

摘要: This paper presents a new approach to inductive learning that combines aspects of instancebased and rule induction in single simple algorithm. The RISE system searches for rules specific-to-general fashion, starting with one per training example, avoids some the difficulties separate-and-eonquer approaches by evaluating each proposed step globally, i e, through an efficient procedure is equivalent checking accuracy set as whole on every example. Classification performed using best-match strategy, reduces nearest-neighbor if all generalizations instances were rejected. An extensive empirical study shows consistently achieves higher accuracies than state-of-the-art representatives its "parent" paradigms (PEBLS CN2), also outperforms decision-tree learner (C4 5) 13 out 15 test domains (in 10 95% confidence).

参考文章(18)
Charles M. Higgins, Padhraic Smyth, Rodney M. Goodman, A hybrid rule-based/bayesian classifier european conference on artificial intelligence. pp. 610- 615 ,(1990)
Tim Niblett, Constructing Decision Trees in Noisy Domains. EWSL. pp. 67- 78 ,(1987)
J. R. Quinlan, Generating production rules from decision trees international joint conference on artificial intelligence. pp. 304- 307 ,(1987)
Robert C. Holte, Bruce W. Porter, Liane E. Acker, Concept learning and the problem of small disjuncts international joint conference on artificial intelligence. pp. 813- 818 ,(1989)
J.R. Quinlan, Combining instance-based and model-based learning international conference on machine learning. pp. 236- 243 ,(1993) , 10.1016/B978-1-55860-307-3.50037-X
Jason Catlett, Mega induction: a Test Flight Machine Learning Proceedings 1991. pp. 596- 599 ,(1991) , 10.1016/B978-1-55860-200-7.50121-5
Carla E. Brodley, Addressing the Selective Superiority Problem: Automatic Algorithm/Model Class Selection Machine Learning Proceedings 1993#R##N#Proceedings of the Tenth International Conference, University of Massachusetts, Amherst, June 27–29, 1993. pp. 17- 24 ,(1993) , 10.1016/B978-1-55860-307-3.50009-5
Nada Lavrac, Igor Mozetic, Jiarong Hong, Ryszard S. Michalski, The multi-purpose incremental learning system AQ15 and its testing application to three medical domains national conference on artificial intelligence. pp. 1041- 1045 ,(1986)
Dietrich Wettschereck, A hybrid nearest-neighbor and nearest-hyperrectangle algorithm european conference on machine learning. pp. 323- 335 ,(1994) , 10.1007/3-540-57868-4_67
Peter Clark, Robin Boswell, Rule induction with CN2: Some recent improvements Lecture Notes in Computer Science. pp. 151- 163 ,(1991) , 10.1007/BFB0017011