Symbolic representation of neural networks

作者: R. Setiono , Huan Liu

DOI: 10.1109/2.485895

关键词:

摘要: Neural networks often surpass decision trees in predicting pattern classifications, but their predictions cannot be explained. This algorithm's symbolic representations make each prediction explicit and understandable. Our approach to understanding a neural network uses rules represent the process. The algorithm, NeuroRule, extracts these from network. can interpreted by which, general, preserve accuracy explain We based NeuroRule on standard three layer feed forward consists of four phases. First, it builds weight decay backpropagation so that weights reflect importance network's connections. Second, prunes remove irrelevant connections units while maintaining predictive accuracy. Third, discretizes hidden unit activation values clustering. Finally, with discretized values.

参考文章(9)
J. R. Quinlan, Comparing connectionist and symbolic learning methods conference on learning theory. pp. 445- 456 ,(1994)
Randy Kerber, ChiMerge: discretization of numeric attributes national conference on artificial intelligence. pp. 123- 128 ,(1992)
Jie Cheng, Usama M. Fayyad, Keki B. Irani, Zhaogang Qian, Improved decision trees: a generalized version of ID3 international conference on machine learning. pp. 100- 106 ,(1988) , 10.1016/B978-0-934613-64-4.50016-5
Thomas G. Dietterich, Hermann Hild, Ghulum Bakiri, A comparative study of ID3 and backpropagation for English text-to-speech mapping international conference on machine learning. pp. 24- 31 ,(1990) , 10.1016/B978-1-55860-141-3.50007-9
Saito, Nakano, Medical diagnostic expert system based on PDP model IEEE 1988 International Conference on Neural Networks. pp. 255- 262 ,(1988) , 10.1109/ICNN.1988.23855
Geoffrey G. Towell, Jude W. Shavlik, Extracting Refined Rules from Knowledge-Based Neural Networks Machine Learning. ,vol. 13, pp. 71- 101 ,(1993) , 10.1023/A:1022683529158
Jude W. Shavlik, Raymond J. Mooney, Geoffrey G. Towell, Symbolic and neural learning algorithms: an experimental comparison Machine Learning. ,vol. 6, pp. 111- 143 ,(1991) , 10.1023/A:1022602303196