Self-Organizing Decomposition of Functions

作者: N. Griffith , D. Partridge

DOI: 10.1007/3-540-45014-9_24

关键词:

摘要: This paper discusses some of the issues raised by various approaches to decomposing functions and modular networks, it offers a unified framework for multiple classifier (MC) systems in general. It argues that as yet there is no general approach this problem although several provide solutions situations which parametric labelling function allows task facing classifying networks be simplified. An MC connectionist system consisting process sub-spaces within based upon similarity patterns its input domain proposed evaluated context previous broader more generally. simple automatic partitioning scheme investigated using different problems, shown effective. The degree are specialized on predictable subset overall assessed, their performance compared with equivalent single-network, undivided multiversion systems. Statistical measures ‘diversity’ previously used assess voting apply measurement specialization or bias groups sub-space nets well useful indicator across range By successively increasing overlap between partitions we show transition from experts subnets, through version sets optimal single classifiers. Finally, presented.

参考文章(24)
Christopher M. Bishop, Neural networks for pattern recognition ,(1995)
David E. Rumelhart, James L. McClelland, , Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations Computational Models of Cognition and Perception. ,(1986) , 10.7551/MITPRESS/5236.001.0001
Derek Partridge, Niall Griffith, Strategies for improving neural net generalisation Neural Computing and Applications. ,vol. 3, pp. 27- 37 ,(1995) , 10.1007/BF01414174
Robert A Jacobs, Michael I Jordan, Andrew G Barto, None, Task Decomposition Through Competition in a Modular Connectionist Architecture: The What and Where Vision Tasks Cognitive Science. ,vol. 15, pp. 219- 250 ,(1991) , 10.1207/S15516709COG1502_2
Peter W. Frey, David J. Slate, Letter Recognition Using Holland-Style Adaptive Classifiers Machine Learning. ,vol. 6, pp. 161- 182 ,(1991) , 10.1023/A:1022606404104
Michael I Jordan, Robert A Jacobs, None, Hierarchical mixtures of experts and the EM algorithm Neural Computation. ,vol. 6, pp. 181- 214 ,(1994) , 10.1162/NECO.1994.6.2.181
D. Partridge, W. Krzanowski, Software diversity: practical statistics for its measurement and exploitation Information & Software Technology. ,vol. 39, pp. 707- 717 ,(1997) , 10.1016/S0950-5849(97)00023-2
Derek Partridge, Network generalization differences quantified Neural Networks. ,vol. 9, pp. 263- 271 ,(1996) , 10.1016/0893-6080(95)00110-7
Robert A. Jacobs, Bias/variance analyses of mixtures-of-experts architectures Neural Computation. ,vol. 9, pp. 369- 383 ,(1997) , 10.1162/NECO.1997.9.2.369
Stuart Geman, Elie Bienenstock, René Doursat, Neural networks and the bias/variance dilemma Neural Computation. ,vol. 4, pp. 1- 58 ,(1992) , 10.1162/NECO.1992.4.1.1