Greedy optimization classifiers ensemble based on diversity

作者: Shasha Mao , L.C. Jiao , Lin Xiong , Shuiping Gou

DOI: 10.1016/J.PATCOG.2010.11.007

关键词: ResidualRandom subspace methodCascading classifiersArtificial intelligenceLinear combinationMatching pursuitIterative methodEnsemble learningMathematicsBasis functionPattern recognition

摘要: Decreasing the individual error and increasing diversity among classifiers are two crucial factors for improving ensemble performances. Nevertheless, ''kappa-error'' diagram shows that enhancing is at expense of reducing accuracy. Hence, a new method named Matching Pursuit Optimization Ensemble Classifiers (MPOEC) proposed in this paper order to balance MPOEC adopts greedy iterative algorithm matching pursuit search an optimal combination entire classifiers, eliminates some similar or poor by giving zero coefficients. In approach, coefficient every classifier gained minimizing residual between target function linear basis functions, especially, when functions similar, their coefficients will be close zeros one iteration optimization process, which indicates obtained based on individuals. Because given coefficients, approach may also considered as selective method. Experimental results show improves performance compared with other methods. Furthermore, kappa-error diagrams indicate increased standard strategies evolutionary ensemble.

参考文章(58)
Ioannis Partalas, Ioannis P. Vlahavas, Grigorios Tsoumakas, Focused Ensemble Selection: A Diversity-Based Method for Greedy Ensemble Selection european conference on artificial intelligence. pp. 117- 121 ,(2008) , 10.3233/978-1-58603-891-5-117
Richard J. Mammone, Artificial neural networks for speech and vision Chapman & Hall. ,(1994)
Sankar K Pal, Amita Pal, Pattern Recognition: From Classical to Modern Approaches WORLD SCIENTIFIC. ,(2001) , 10.1142/4755
Xiangrong Zhang, Shuang Wang, Tan Shan, Licheng Jiao, Selective SVMs ensemble driven by immune clonal algorithm Lecture Notes in Computer Science. pp. 325- 333 ,(2005) , 10.1007/978-3-540-32003-6_33
Ivor W. Tsang, James T. Kwok, Ensembles of partially trained SWMs with multiplicative updates international joint conference on artificial intelligence. pp. 1089- 1094 ,(2007)
T. Ban, S. Abe, SVM ensembles for selecting the relevant feature subsets international joint conference on neural network. ,vol. 2, pp. 943- 948 ,(2005) , 10.1109/IJCNN.2005.1555979
Steven L. Salzberg, Alberto Segre, Programs for Machine Learning ,(1994)
Nitesh V. Chawla, Jared Sylvester, Exploiting diversity in ensembles: improving the performance on unbalanced datasets international conference on multiple classifier systems. pp. 397- 406 ,(2007) , 10.1007/978-3-540-72523-7_40
Thomas G. Dietterich, Dragos D. Margineantu, Pruning Adaptive Boosting international conference on machine learning. pp. 211- 218 ,(1997)