Feature selection using tabu search with long-term memories and probabilistic neural networks

作者: Yong Wang , Lin Li , Jun Ni , Shuhong Huang

DOI: 10.1016/J.PATREC.2009.02.001

关键词: Feature selectionMachine learningArtificial neural networkArtificial intelligenceTabu searchDimensionality reductionProbabilistic neural networkBackpropagationProbabilistic logicMathematicsSearch algorithmSignal processingSoftwareComputer Vision and Pattern Recognition

摘要: Feature selection is a dimensionality reduction problem in order to reduce measurement costs, shorten computational time, relieve the curse of dimensionality, and improve classification accuracy. In this paper, hybrid approach using tabu search probabilistic neural networks proposed applied feature problems. The algorithm differs from previous research by long-term memory instead short-term avoid necessity delicate tuning length decrease risk generating cycle that traps local optimal solutions. integrated are an outgrowth Bayesian classifiers outperform backpropagation-based their global convergence rapid training. Extensive experiments on real-world data sets performed comparison with indicates can select equal or smaller number features while improving

参考文章(30)
Ron Kohavi, George John, Wrappers for feature selection Artificial Intelligence. ,(1997)
Eric Taillard, Patrick Siarry, Johann Dreo, Alain Petrowski, Metaheuristics for Hard Optimization: Methods and Case Studies ,(2005)
Narendra, Fukunaga, A Branch and Bound Algorithm for Feature Subset Selection IEEE Transactions on Computers. ,vol. 26, pp. 917- 922 ,(1977) , 10.1109/TC.1977.1674939
Christopher M. Bishop, Neural networks for pattern recognition ,(1995)
Philip D. Wasserman, Advanced methods in neural computing ,(1989)
Donald F. Specht, Probabilistic neural networks Neural Networks. ,vol. 3, pp. 109- 118 ,(1990) , 10.1016/0893-6080(90)90049-Q
Thomas M. Cover, Jan M. Van Campenhout, On the Possible Orderings in the Measurement Selection Problem IEEE Transactions on Systems, Man, and Cybernetics. ,vol. 7, pp. 657- 661 ,(1977) , 10.1109/TSMC.1977.4309803
Bin Yu, Baozong Yuan, A more efficient branch and bound algorithm for feature selection Pattern Recognition. ,vol. 26, pp. 883- 889 ,(1993) , 10.1016/0031-3203(93)90054-Z
W. Siedlecki, J. Sklansky, A note on genetic algorithms for large-scale feature selection Pattern Recognition Letters. ,vol. 10, pp. 335- 347 ,(1989) , 10.1016/0167-8655(89)90037-8
P. Pudil, J. Novovičová, J. Kittler, Floating search methods in feature selection Pattern Recognition Letters. ,vol. 15, pp. 1119- 1125 ,(1994) , 10.1016/0167-8655(94)90127-9