An experimental study of several decision issues for feature selection with multi-layer perceptrons

作者: E. Romero , J.M. Sopena

DOI: 10.1109/IJCNN.2005.1556181

关键词:

摘要: An experimental study of several decision issues for wrapper feature selection with multi-layer perceptrons is presented, namely the stopping criterion, data set where saliency measured and network retraining before computing saliency. Experimental results sequential backward procedure indicate that increase in computational cost associated every temporarily removed rewarded a significant performance improvement. Despite being quite intuitive, this idea has been hardly used practice. Regarding criterion measured, profits from measuring validation set, as reasonably expected. A somehow non-intuitive conclusion can be drawn by looking at it suggested forcing overtraining may useful early stopping.

参考文章(21)
Tautvydas Cibas, Françroise Fogelman Soulié, Patrick Gallinari, Sarunas Raudys, Variable Selection with Optimal Cell Damage ICANN ’94. pp. 727- 730 ,(1994) , 10.1007/978-1-4471-2097-1_171
B. D. Ripley, Statistical Ideas for Selecting Network Architectures SNN Symposium on Neural Networks. pp. 183- 190 ,(1995) , 10.1007/978-1-4471-3087-1_36
George H John, Ron Kohavi, Karl Pfleger, None, Irrelevant Features and the Subset Selection Problem Machine Learning Proceedings 1994. pp. 121- 129 ,(1994) , 10.1016/B978-1-55860-335-6.50023-4
V. Onnia, M. Tico, J. Saarinen, Feature selection method using neural network international conference on image processing. ,vol. 1, pp. 513- 516 ,(2001) , 10.1109/ICIP.2001.959066
A. Verikas, M. Bacauskiene, Feature selection with neural networks Pattern Recognition Letters. ,vol. 23, pp. 1323- 1335 ,(2002) , 10.1016/S0167-8655(02)00081-8
Jack Sklansky, Mineichi Kudo, Comparison of algorithms that select features for pattern classifiers Pattern Recognition. ,vol. 33, pp. 25- 41 ,(2000) , 10.1016/S0031-3203(99)00041-2
Avrim L. Blum, Pat Langley, Selection of relevant features and examples in machine learning Artificial Intelligence. ,vol. 97, pp. 245- 271 ,(1997) , 10.1016/S0004-3702(97)00063-5
C. L. Blake, UCI Repository of machine learning databases www.ics.uci.edu/〜mlearn/MLRepository.html. ,(1998)
PIËRRE VAN DE LAAR, TOM HESKES, STAN GIELEN, Partial retraining: a new approach to input relevance determination. International Journal of Neural Systems. ,vol. 9, pp. 75- 85 ,(1999) , 10.1142/S0129065799000071