Fast Multistage Algorithm for K-NN Classifiers

作者: I. Soraluze , C. Rodriguez , F. Boto , A. Cortes

DOI: 10.1007/978-3-540-24586-5_55

关键词: Random subspace methodNISTCascading classifiersImage processingComputer scienceAlgorithmSpeech processingClassifier (linguistics)Classifier (UML)

摘要: In this paper we present a way to reduce the computational cost of k-NN classifiers without losing classification power. Hierarchical or multistage have been built with purpose. These are designed putting incrementally trained into hierarchy and using rejection techniques in all levels apart from last. Results presented for different benchmark data sets: some standard sets taken UCI Repository Statlog Project, NIST Special Databases (digits upper-case lower-case letters). cases reduction is obtained maintaining recognition rate best individual classifier obtained.

参考文章(13)
R Allen Wilkinson, Jon Geist, Stanley Janet, Patrick J Grother, Christopher J C Burges, Robert Creecy, Bob Hammond, Jonathan J Hull, Norman L Larsen, Thomas P Vogl, Charles L Wilson, The First Census Optical Character Recognition Systems Conference | NIST NIST Interagency/Internal Report (NISTIR) - 4912. ,(1992) , 10.6028/NIST.IR.4912
S. K. Murthy, S. Kasif, S. Salzberg, A system for induction of oblique decision trees Journal of Artificial Intelligence Research. ,vol. 2, pp. 1- 32 ,(1994) , 10.1613/JAIR.63
László Györfi, Luc Devroye, Gábor Lugosi, A Probabilistic Theory of Pattern Recognition ,(1996)
Belur V. Dasarathy, Nearest neighbor (NN) norms: NN pattern classification techniques Los Alamitos: IEEE Computer Society Press. ,(1991)
V.Vijaya Saradhi, M.Narasimha Murty, Bootstrapping for efficient handwritten digit recognition Pattern Recognition. ,vol. 34, pp. 1047- 1056 ,(2001) , 10.1016/S0031-3203(00)00043-1
P. Hart, The condensed nearest neighbor rule (Corresp.) IEEE Transactions on Information Theory. ,vol. 14, pp. 515- 516 ,(1968) , 10.1109/TIT.1968.1054155
Roberto Paredes, Enrique Vidal, A class-dependent weighted dissimilarity measure for nearest neighbor classification problems Pattern Recognition Letters. ,vol. 21, pp. 1027- 1036 ,(2000) , 10.1016/S0167-8655(00)00064-7
C. L. Blake, UCI Repository of machine learning databases www.ics.uci.edu/〜mlearn/MLRepository.html. ,(1998)
Tin Kam Ho, J.J. Hull, S.N. Srihari, Decision combination in multiple classifier systems IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 16, pp. 66- 75 ,(1994) , 10.1109/34.273716