Particle swarm optimisation-based KNN for improving KNN and ensemble classification performance

作者: Debojit Boro , Dhruba K. Bhattacharyya

DOI: 10.1504/IJICA.2015.073004

关键词:

摘要: In this paper we use KNN algorithm for our ensemble classification process that finds out the nearest K training samples given a test sample where each is predictions vector generated by combined computation of classifiers and algebraic combiners. attempt to reduce computational time involved in finding KNN, used particle swarm optimisation PSO with which randomly selects from set until global consensus reached among particles label an appropriate class weighted majority voting WMV samples. The proposed method demonstrated better performance as compared other traditional methods terms generalisation accuracies when tested over several datasets UCI repository high dimensional datasets.

参考文章(17)
David H. Wolpert, Original Contribution: Stacked generalization Neural Networks. ,vol. 5, pp. 241- 259 ,(1992) , 10.1016/S0893-6080(05)80023-1
Mohd Aizaini Maarof, Siti Mariyam Shamsuddin, Anazida Zainal, Ensemble classifiers for network intrusion detection system Dynamic Pub.. ,(2009)
Behrouz Minaei-Bidgoli, Gerd Kortemeyer, William F Punch, None, Optimizing Classification Ensembles via a Genetic Algorithm for a Web-Based Educational System Lecture Notes in Computer Science. pp. 397- 406 ,(2004) , 10.1007/978-3-540-27868-9_42
Ali Borji, Combining heterogeneous classifiers for network intrusion detection ASIAN'07 Proceedings of the 12th Asian computing science conference on Advances in computer science: computer and network security. pp. 254- 260 ,(2007) , 10.1007/978-3-540-76929-3_24
Jinghua Yan, Xiaochun Yun, Peng Zhang, Jianlong Tan, Li Guo, A New Weighted Ensemble Model for Detecting DoS Attack Streams web intelligence. ,vol. 3, pp. 227- 230 ,(2010) , 10.1109/WI-IAT.2010.264
Jingzhong Wang, Xia Li, An improved KNN algorithm for text classification international conference on information networking. ,vol. 2, ,(2010) , 10.1109/ICINA.2010.5636476
Ioan Cristian Trelea, The particle swarm optimization algorithm: convergence analysis and parameter selection Information Processing Letters. ,vol. 85, pp. 317- 325 ,(2003) , 10.1016/S0020-0190(02)00447-7
Yuan Jiang, Shi-Fu Chen, Zhi-Hua Zhou, Jian-Xin Wu, Genetic algorithm based selective neural network ensemble international joint conference on artificial intelligence. pp. 797- 802 ,(2001)
Richard Maclin, David Opitz, Popular ensemble methods: an empirical study Journal of Artificial Intelligence Research. ,vol. 11, pp. 169- 198 ,(1999) , 10.1613/JAIR.614
Alejandro Cervantes, Ines Galvan, Pedro Isasi, Building Nearest Prototype Classifiers Using a Michigan Approach PSO ieee swarm intelligence symposium. pp. 135- 140 ,(2007) , 10.1109/SIS.2007.368037