A genetic feature weighting scheme for pattern recognition

作者: Heesung Lee , Euntai Kim , Mignon Park

DOI: 10.3233/ICA-2007-14204

关键词: Scheme (programming language)Numeral systemSet (abstract data type)Weight valuePattern recognition (psychology)WeightingFeature (machine learning)Pattern recognitionComputer scienceOverfittingArtificial intelligence

摘要: This paper proposes a new pattern recognition scheme, combining adaptive feature weighting and modified k-Nearest Neighbor (k-NN) rule. The proposed method named adaptive-3FW. It uses three non-uniform weight levels (zero weight, middle full weight) to each feature. value is determined using genetic algorithms (GAs). adaptive-3FW overcomes overfitting issues achieves high performance. Novel GA operators tailored for this formulation are introduced implement the scheme. Further, k-NN which class-dependent strategy. Whilst conventional systems use same set of weights all classes, algorithm different sets classes. Experiments were performed with UCI repository machine learning databases unconstrained handwritten numeral database Concordia University in Canada show performance method.

参考文章(17)
James D. Kelly, Lawrence Davis, Hybridizing the Genetic Algorithm and the K Nearest Neighbors Classification Algorithm. ICGA. pp. 377- 383 ,(1991)
Ron Kohavi, Yeogirl Yun, Pat Langley, The Utility of Feature Weighting in Nearest-Neighbor Algorithms ECML. ,(1997)
William F. Punch, Richard J. Enbody, Paul D. Hovland, Min Pei, Erik D. Goodman, Lai Chia-Shun, Further Research on Feature Selection and Classification Using Genetic Algorithms international conference on genetic algorithms. pp. 557- 564 ,(1993)
W. Siedlecki, J. Sklansky, A note on genetic algorithms for large-scale feature selection Pattern Recognition Letters. ,vol. 10, pp. 335- 347 ,(1989) , 10.1016/0167-8655(89)90037-8
L. S. Oliveira, R. Sabourin, F. Bortolozzi, C. Y. Suen, A METHODOLOGY FOR FEATURE SELECTION USING MULTIOBJECTIVE GENETIC ALGORITHMS FOR HANDWRITTEN DIGIT STRING RECOGNITION International Journal of Pattern Recognition and Artificial Intelligence. ,vol. 17, pp. 903- 929 ,(2003) , 10.1142/S021800140300271X
Jin-Hyuk Hong, Sung-Bae Cho, Efficient huge-scale feature selection with speciated genetic algorithm Pattern Recognition Letters. ,vol. 27, pp. 143- 150 ,(2006) , 10.1016/J.PATREC.2005.07.009
F. Hussein, N. Kharma, R. Ward, Genetic algorithms for feature selection and weighting, a review and study international conference on document analysis and recognition. pp. 1240- 1244 ,(2001) , 10.1109/ICDAR.2001.953980
Melanie Mitchell, An Introduction to Genetic Algorithms ,(1996)
Il-Seok Oh, Jin-Seon Lee, Byung-Ro Moon, Hybrid genetic algorithms for feature selection IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 26, pp. 1424- 1437 ,(2004) , 10.1109/TPAMI.2004.105