Prototype Based Classification Using Information Theoretic Learning

作者: Th. Villmann , B. Hammer , F. -M. Schleif , T. Geweniger , T. Fischer

DOI: 10.1007/11893257_5

关键词: Vector quantizationComputer scienceGeneralization errorStability (learning theory)Linear classifierSupervised learningWake-sleep algorithmMutual informationLearning vector quantizationCompetitive learningArtificial neural networkSemi-supervised learningUnsupervised learningArtificial intelligenceFuzzy logicFuzzy classificationMachine learning

摘要: In this article we extend the (recently published) unsupervised information theoretic vector quantization approach based on Cauchy–Schwarz-divergence for matching data and prototype densities to supervised learning classification. particular, first generalize method more general metrics instead of Euclidean, as it was used in original algorithm. Thereafter, model a resulting fuzzy classification Thereby, allow labels both, prototypes. Finally, transfer idea relevance metric adaptation known from new approach.

参考文章(31)
Charles J. Zurada, Jacek M., Marks, Robert J., Robinson, Computational Intelligence: Imitating Life IEEE Press. ,(1994)
Kari Torkkola, William M. Campbell, Mutual Information in Learning Feature Transformations international conference on machine learning. pp. 1015- 1022 ,(2000)
Deniz Erdogmus, Jose C. Principe, Information Theoretic Learning Information Theoretic Learning by Jose C. Principe. pp. 902- 909 ,(2010) , 10.4018/978-1-59904-849-9.CH133
Teuvo Kohonen, Self-Organizing Maps ,(1995)
S. Kullback, R. A. Leibler, On Information and Sufficiency Annals of Mathematical Statistics. ,vol. 22, pp. 79- 86 ,(1951) , 10.1214/AOMS/1177729694
Alberto Prieto, Joan Cabestany, Francisco Sandoval, Editorial: Computational intelligence and bioinspired systems Neurocomputing. ,vol. 70, pp. 2701- 2703 ,(2007) , 10.1016/J.NEUCOM.2006.06.009
CE Shennon, Warren Weaver, A mathematical theory of communication Bell System Technical Journal. ,vol. 27, pp. 379- 423 ,(1948) , 10.1002/J.1538-7305.1948.TB01338.X
Gustavo Deco, Dragan Obradovic, An Information-Theoretic Approach to Neural Computing ,(1996)