Divide-and-conquer learning and modular perceptron networks

作者: Hsin-Chia Fu , Yen-Po Lee , Cheng-Chin Chiang , Hsiao-Tien Pao

DOI: 10.1109/72.914522

关键词:

摘要: A novel modular perceptron network (MPN) and divide-and-conquer learning (DCL) schemes for the design of neural networks are proposed. When a training process in multilayer falls into local minimum or stalls flat region, proposed DCL scheme is applied to divide current data region two easier be learned regions. The continues when self-growing its initial weight estimation constructed one newly partitioned Another will resume on original network. Data partitioning, estimating iteratively repeated until all completely by MPN. We evaluated compared MPN with several representative two-spirals problem real-world dataset. achieved better performance requiring much less presentations during phases, generalization performance, processing time retrieving phase.

参考文章(28)
K. Lang, Learning to tell two spirals apart Proceedings of the 1988 Connectionist Models Summer School. ,(1989)
Cheng-Chin Chiang, Hsin-Chia Fu, A divide-and-conquer methodology for modular supervised neural network design world congress on computational intelligence. ,vol. 1, pp. 119- 124 ,(1994) , 10.1109/ICNN.1994.374149
Nir Friedman, Dan Geiger, Moises Goldszmidt, Bayesian Network Classifiers Machine Learning. ,vol. 29, pp. 131- 163 ,(1997) , 10.1023/A:1007465528199
Yoav Freund, Robert E Schapire, A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting conference on learning theory. ,vol. 55, pp. 119- 139 ,(1997) , 10.1006/JCSS.1997.1504
L. G. Valiant, A theory of the learnable symposium on the theory of computing. ,vol. 27, pp. 1134- 1142 ,(1984) , 10.1145/800057.808710
Michael I Jordan, Robert A Jacobs, None, Hierarchical mixtures of experts and the EM algorithm Neural Computation. ,vol. 6, pp. 181- 214 ,(1994) , 10.1162/NECO.1994.6.2.181
Ury Naftaly, Nathan Intrator, David Horn, Optimal ensemble averaging of neural networks Network: Computation In Neural Systems. ,vol. 8, pp. 283- 296 ,(1997) , 10.1088/0954-898X_8_3_004
GASSER AUDA, MOHAMED KAMEL, Modular neural networks: a survey. International Journal of Neural Systems. ,vol. 9, pp. 129- 151 ,(1999) , 10.1142/S0129065799000125
Nicolaos B. Karayiannis, Hybrid learning schemes for fast training of feed-forward neural networks Mathematics and Computers in Simulation. ,vol. 41, pp. 13- 28 ,(1996) , 10.1016/0378-4754(95)00055-0