Constructive neural-network learning algorithms for pattern classification

作者: R. Parekh , J. Yang , V. Honavar

DOI: 10.1109/72.839013

关键词: Artificial intelligenceAlgorithmPruning (decision trees)Pyramid (image processing)Network architectureMachine learningConstructiveNetwork topologyComputer science

摘要: Constructive learning algorithms offer an attractive approach for the incremental construction of near-minimal neural-network architectures pattern classification. They help overcome need ad hoc and often inappropriate choices network topology in that search suitable weights a priori fixed architectures. Several such are proposed literature shown to converge zero classification errors (under certain assumptions) on tasks involve binary mapping (i.e., problems involving binary-valued input attributes two output categories). We present constructive algorithms, MPyramid-real MTiling-real, extend pyramid tiling respectively, real M-ary mappings real-valued multiple classes). prove convergence these empirically demonstrate their applicability practical problems. Additionally, we show how incorporation local pruning step can eliminate several redundant neurons from MTiling-real networks.

参考文章(52)
Rajesh Parekh, Vasant Honavar, G.-Z. Yang, Pruning strategies for constructive neural network learning algorithms ,(1997)
R. G. Parekh, Vasant Honavar, J. Yang, Karthik Balakrishnan, Chun-Hsien Chen, Analysis of Decision Boundaries Generated by Constructive Neural Network Learning Algorithms ,(1995)
Thomas Kailath, Vwani Roychowdhury, Kai-Yeung Siu, Discrete Neural Computation: A Theoretical Foundation ,(1995)
Sebastian Thrun, Lifelong Learning: A Case Study. Defense Technical Information Center. ,(1995) , 10.21236/ADA303191
T. G. Dietterich, G. Bakiri, Solving multiclass learning problems via error-correcting output codes Journal of Artificial Intelligence Research. ,vol. 2, pp. 263- 286 ,(1994) , 10.1613/JAIR.105
James Dougherty, Ron Kohavi, Mehran Sahami, Supervised and Unsupervised Discretization of Continuous Features Machine Learning Proceedings 1995. pp. 194- 202 ,(1995) , 10.1016/B978-1-55860-377-6.50032-3