Heterogeneous distance functions for prototype rules : influence of parameters on probability estimation

作者: M. Blachnik , W. Duch , T. Wieczorek

DOI:

关键词: Simple (abstract algebra)Binary numberSelection (genetic algorithm)Process (computing)Probability density functionSimilarity (geometry)Data miningMeasure (mathematics)MathematicsPosition (vector)

摘要: An interesting and little explored way to understand data is based on prototype rules (P-rules). The goal of this approach find optimal similarity (or distance) functions position prototypes which unknown vectors are compared. In real applications frequently involve different types attributes, such as continuous, discrete, binary or nominal. Heterogeneous distance that may handle diverse information usually probability measure, the Value Difference Metrics (VDM). For continuous attributes calculation probabilities requires estimations density functions. This process careful selection several parameters have important impact overall classification accuracy. paper various heterogeneous function VDM measure presented, among them some new estimation. Results many numerical experiments with presented artificial datasets, quite simple P-rules for databases extracted.

参考文章(14)
Robert Tibshirani, Trevor Hastie, Jerome H. Friedman, The Elements of Statistical Learning ,(2001)
Włodzisław Duch, Similarity-based methods: a general framework for classification, approximation and association Control and Cybernetics. ,vol. 29, pp. 937- 967 ,(2000)
Enrico Blanzieri, Francesco Ricci⋆, Probability Based Metrics for Nearest Neighbor Classification and Case-Based Reasoning international conference on case based reasoning. pp. 14- 28 ,(1999) , 10.1007/3-540-48508-2_2
Frank Klawonn, Rudolf Kruse, Detlef Nauck, Foundations of neuro-fuzzy systems ,(1997)
Włodzisław Duch, Visualization of Hidden Node Activity in Neural Networks: II. Application to RBF Networks international conference on artificial intelligence and soft computing. pp. 44- 49 ,(2004) , 10.1007/978-3-540-24844-6_6
Włodzisław Duch, Marcin Blachnik, Fuzzy Rule-Based Systems Derived from Similarity to Prototypes international conference on neural information processing. pp. 912- 917 ,(2004) , 10.1007/978-3-540-30499-9_140
C. L. Blake, UCI Repository of machine learning databases www.ics.uci.edu/〜mlearn/MLRepository.html. ,(1998)
Włodzisław Duch, Visualization of Hidden Node Activity in Neural Networks: I. Visualization Methods international conference on artificial intelligence and soft computing. pp. 38- 43 ,(2004) , 10.1007/978-3-540-24844-6_5
W. Duch, K. Grudzinski, Prototype based rules-a new way to understand the data international joint conference on neural network. ,vol. 3, pp. 1858- 1863 ,(2001) , 10.1109/IJCNN.2001.938446