Cascade Generalization

作者: João Gama , Pavel Brazdil

DOI: 10.1023/A:1007652114878

关键词:

摘要: Using multiple classifiers for increasing learning accuracy is an active research area. In this paper we present two related methods merging classifiers. The first method, Cascade Generalization, couples loosely. It belongs to the family of stacking algorithms. basic idea Generalization use sequentially set classifiers, at each step performing extension original data by insertion new attributes. attributes are derived from probability class distribution given a base classifier. This constructive extends representational language high level relaxing their bias. second method exploits tight coupling applying locally. At iteration divide and conquer algorithm, reconstruction instance space occurs addition Each attribute represents that example We have implemented three Local Algorithms. merges linear discriminant with decision tree, naive Bayes third tree. All algorithms show increase performance, when compared corresponding single models. also outperforms other combining like Stacked competes well against Boosting statistically significant confidence levels.

参考文章(30)
David H. Wolpert, Original Contribution: Stacked generalization Neural Networks. ,vol. 5, pp. 241- 259 ,(1992) , 10.1016/S0893-6080(05)80023-1
Salvatore J. Stolfo, Philip K. Chan, Learning arbiter and combiner trees from partitioned data for scaling machine learning knowledge discovery and data mining. pp. 39- 44 ,(1995)
Philip K. Chan, Salvatore J. Stolfo, A Comparative Evaluation of Voting and Meta-learning on Partitioned Data Machine Learning Proceedings 1995. pp. 90- 98 ,(1995) , 10.1016/B978-1-55860-377-6.50020-7
S. K. Murthy, S. Kasif, S. Salzberg, A system for induction of oblique decision trees Journal of Artificial Intelligence Research. ,vol. 2, pp. 1- 32 ,(1994) , 10.1613/JAIR.63
Ron Kohavi, David Wolpert, Bias plus variance decomposition for zero-one loss functions international conference on machine learning. pp. 275- 283 ,(1996)
Cullen Schaffer, Technical Note : Selecting a Classification Method by Cross-Validation Machine Learning. ,vol. 13, pp. 135- 143 ,(1993) , 10.1023/A:1022639714137
Pat Langley, Elements of Machine Learning ,(1995)
João Gama, Combining Classifiers by Constructive Induction european conference on machine learning. pp. 178- 189 ,(1998) , 10.1007/BFB0026688
Pat Langley, Induction of Recursive Bayesian Classifiers european conference on machine learning. pp. 153- 164 ,(1993) , 10.1007/3-540-56602-3_134
David Bingham Skalak, Prototype Selection for Composite Nearest Neighbor Classifiers University of Massachusetts. ,(1995)