Incremental learning by heterogeneous bagging ensemble

作者: Qiang Li Zhao , Yan Huang Jiang , Ming Xu

DOI: 10.1007/978-3-642-17313-4_1

关键词: AdaBoostEnsemble learningMachine learningClassifier (UML)Artificial intelligenceIncremental learningComputer science

摘要: Classifier ensemble is a main direction of incremental learning researches, and many ensemble-based methods have been presented. Among them, Learn++, which derived from the famous algorithm, AdaBoost, special. Learn++ can work with any type classifiers, either they are specially designed for or not, this makes potentially supports heterogeneous base classifiers. Based on massive experiments we analyze advantages disadvantages Learn++. Then new method, Bagging++, presented, based another method: Bagging. The experimental results show that Bagging promising method Bagging++ has better generalization speed than other compared such as NCL.

参考文章(17)
Christophe Giraud-Carrier, A note on the utility of incremental learning Ai Communications. ,vol. 13, pp. 215- 223 ,(2000)
T. Seipone, J.A. Bullinaria, Evolving improved incremental learning schemes for neural network systems congress on evolutionary computation. ,vol. 3, pp. 2002- 2009 ,(2005) , 10.1109/CEC.2005.1554941
H. Inoue, H. Narihisa, Self-organizing neural grove and its applications international joint conference on neural network. ,vol. 2, pp. 1205- 1210 ,(2005) , 10.1109/IJCNN.2005.1556025
Janez Demšar, Statistical Comparisons of Classifiers over Multiple Data Sets Journal of Machine Learning Research. ,vol. 7, pp. 1- 30 ,(2006)
Marcus A. Maloof, Ryszard S. Michalski, Incremental learning with partial instance memory Artificial Intelligence. ,vol. 154, pp. 95- 126 ,(2004) , 10.1016/J.ARTINT.2003.04.001
Gail A. Carpenter, Stephen Grossberg, John H. Reynolds, ARTMAP: Supervised real-time learning and classification of nonstationary data by a self-organizing neural network Neural Networks. ,vol. 4, pp. 565- 588 ,(1991) , 10.1016/0893-6080(91)90012-T
K Tang, M Lin, L Minku, X Yao, Selective negative correlation learning approach to incremental learning Neurocomputing. ,vol. 72, pp. 2796- 2805 ,(2009) , 10.1016/J.NEUCOM.2008.09.022
Robi Polikar, Lalita Upda, Satish S Upda, Vasant Honavar, Learn++: an incremental learning algorithm for supervised neural networks systems man and cybernetics. ,vol. 31, pp. 497- 508 ,(2001) , 10.1109/5326.983933
Tomaso Poggio, Gert Cauwenberghs, Incremental and Decremental Support Vector Machine Learning neural information processing systems. ,vol. 13, pp. 409- 415 ,(2000)
Paul E. Utgoff, Incremental Induction of Decision Trees Machine Learning. ,vol. 4, pp. 161- 186 ,(1989) , 10.1023/A:1022699900025