Task decomposition and modular single-hidden-layer perceptron classifiers for multi-class learning problems

作者: Gao Daqi , Li Chunxia , Yang Yunfan

DOI: 10.1016/J.PATCOG.2007.01.002

关键词:

摘要: One of keys for multilayer perceptrons (MLPs) to solve the multi-class learning problems is how make them get good convergence and generalization performances merely through small-scale subsets, i.e., a small part original larger-scale data sets. This paper first decomposes an n-class problem into n two-class problems, then uses class-modular MLPs one by one. A MLP responsible forming decision boundaries its represented class, thus can be trained only samples from class some neighboring ones. When solving problem, has face with such unfavorable situations as unbalanced training data, locally sparse weak distribution regions, open boundaries. solutions that minority classes or in thin regions are virtually reinforced suitable enlargement factors. And next, effective range localized correction coefficient related class. In brief, this focuses on formation economic virtual balance imbalanced sets, localization MLPs. The results letter extended handwritten digital recognitions show proposed methods effective.

参考文章(41)
Iván Cantador, José R. Dorronsoro, Parallel Perceptrons, Activation Margins and Imbalanced Training Set Pruning Pattern Recognition and Image Analysis. pp. 43- 50 ,(2005) , 10.1007/11492542_6
Christopher M. Bishop, Neural networks for pattern recognition ,(1995)
Jamshid Dehmeshki, Mustafa Karaköy, Manlio Valdivieso Casique, A rule-based scheme for filtering examples from majority class in an imbalanced training set machine learning and data mining in pattern recognition. pp. 215- 223 ,(2003) , 10.1007/3-540-45065-3_19
R.P. Lippmann, Pattern classification using neural networks IEEE Communications Magazine. ,vol. 27, pp. 47- 50 ,(1989) , 10.1109/35.41401
Sergio Bermejo, Joan Cabestany, Oriented principal component analysis for large margin classifiers Neural Networks. ,vol. 14, pp. 1447- 1461 ,(2001) , 10.1016/S0893-6080(01)00106-X
Yi L. Murphey, Hong Guo, Lee A. Feldkamp, Neural Learning from Unbalanced Data Applied Intelligence. ,vol. 21, pp. 117- 128 ,(2004) , 10.1023/B:APIN.0000033632.42843.17
Peter W. Frey, David J. Slate, Letter Recognition Using Holland-Style Adaptive Classifiers Machine Learning. ,vol. 6, pp. 161- 182 ,(1991) , 10.1023/A:1022606404104