Extraction of Logical Rules from Neural Networks

作者: Włodzisław Duch , Rafał Adamczak , Krzysztof Grąbczewski

DOI: 10.1023/A:1009670302979

关键词: Function (mathematics)Computer scienceFeature selectionBackpropagationComplex systemComputational intelligenceForcing (recursion theory)Artificial neural networkLogical rulesArtificial intelligenceData mining

摘要: Three neural-based methods for extraction of logical rules from data are presented. These facilitate conversion graded response neural networks into performing functions. MLP2LN method tries to convert a standard MLP network operations (LN). C-MLP2LN is constructive algorithm creating such networks. Logical interpretation assured by adding constraints the cost function, forcing weights ±1 or 0. Skeletal emerge ensuring that minimal number found. In both covering many training examples generated before more specific exceptions. The third method, FSM2LN, based on probability density estimation. Several performance these

参考文章(7)
Peter W. Pachowicz, Scott E. Fahlman, Ivan Bratko, Haleh Vafaie, Saso Dzeroski, Igor Kononenko, Bojan Cestnik, Janusz Wnek, Jerzy W. Bala, Sebastian B. Thrun, Kenneth A. De Jong, Kenneth A. Kaufman, Douglas H. Fisher, John Cheng, Eric Bloedorn, Juergen S. Kreuziger, Walter Van de Welde, Tom A. Mitchell, Ryszard S. Michalski, Jianping Zhang, Walter Wenzel, Rainer Hamann, Stefan Keller, The MONK's problems: A Performance Comparison of Different Learning Algorithms ,(1991)
K.-P. Huber, M.R. Berthold, Building precise classifiers with automatic rule extraction international conference on networks. ,vol. 3, pp. 1263- 1268 ,(1995) , 10.1109/ICNN.1995.487337
Włodzisław Duch, Geerd H.F. Diercksen, Feature space mapping as a universal adaptive system Computer Physics Communications. ,vol. 87, pp. 341- 371 ,(1995) , 10.1016/0010-4655(95)00023-9
Robert Andrews, Joachim Diederich, Alan B. Tickle, Survey and critique of techniques for extracting rules from trained artificial neural networks Knowledge Based Systems. ,vol. 8, pp. 373- 389 ,(1995) , 10.1016/0950-7051(96)81920-4
J.-S.R. Jang, C.-T. Sun, Functional equivalence between radial basis function networks and fuzzy inference systems IEEE Transactions on Neural Networks. ,vol. 4, pp. 156- 159 ,(1993) , 10.1109/72.182710
David J. C. MacKay, A practical Bayesian framework for backpropagation networks Neural Computation. ,vol. 4, pp. 448- 472 ,(1992) , 10.1162/NECO.1992.4.3.448
C. Merz, UCI Repository of Machine Learning Databases University of California, Department of Information. ,(1996)