Ensembling evidential k-nearest neighbor classifiers through multi-modal perturbation

作者: Hakan Altınçay

DOI: 10.1016/J.ASOC.2006.10.002

关键词: Pattern recognitionClassifier (UML)Artificial intelligenceRandom subspace methodQuadratic classifierMathematicsPerturbation (astronomy)Linear subspacek-nearest neighbors algorithmModalMargin classifier

摘要: Ensembling techniques have already been considered for improving the accuracy of k-nearest neighbor classifier. It is shown that using different feature subspaces each member classifier, strong ensembles can be generated. Although it has a more flexible structure which an obvious advantage from diversity point view and observed to provide better classification accuracies compared voting based k-NN ensembling evidential classifier on Dempster-Shafer theory evidence not yet fully studied. In this paper, we firstly investigate performance random subspace method. Taking into account its potential perturbed also in parameter dimension due class dependent parameters, propose through multi-modal perturbation genetic algorithms. Experimental results improved obtained method further surpassed perturbation.

参考文章(63)
William M. Spears, Adapting Crossover in Evolutionary Algorithms. Evolutionary Programming. pp. 367- 384 ,(1995)
Stephen D. Bay, Combining Nearest Neighbor Classifiers Through Multiple Feature Subsets international conference on machine learning. pp. 37- 45 ,(1998)
Patrice Latinne, Olivier Debeir, Christine Decaestecker, Different Ways of Weakening Decision Trees and Their Impact on Classification Accuracy of DT Combination Multiple Classifier Systems. pp. 200- 209 ,(2000) , 10.1007/3-540-45014-9_19
Tin Kam Ho, Nearest Neighbors in Random Subspaces Lecture Notes in Computer Science. pp. 640- 648 ,(1998) , 10.1007/BFB0033288
Yongguang Bao, Naohiro Ishii, Xiaoyong Du, Combining Multiple k-Nearest Neighbor Classifiers Using Different Distance Functions Lecture Notes in Computer Science. pp. 634- 641 ,(2004) , 10.1007/978-3-540-28651-6_93
Larry J. Eshelman, J. David Schaffer, Real-Coded Genetic Algorithms and Interval-Schemata foundations of genetic algorithms. ,vol. 2, pp. 187- 202 ,(1993) , 10.1016/B978-0-08-094832-4.50018-0
Runwei Cheng, 光男 玄, Genetic algorithms and engineering design ,(1997)