Random brains

作者: Tuve Lofstrom , Henrik Bostrom , Ulf Johansson

DOI:

关键词:

摘要: In this paper, we introduce and evaluate a novel method, called random brains, for producing neural network ensembles. The suggested which is heavily inspired by the forest technique, produces diversity implicitly using bootstrap training randomized architectures. More specifically, each base classifier multilayer perceptron, number of randomly selected links between input layer hidden are removed prior to training, thus resulting in potentially weaker but more diverse classifiers. experimental results on 20 UCI data sets show that brains obtained significantly higher accuracy AUC, compared standard bagging similar networks not utilizing analysis shows main reason increased ensemble performance ability produce effective diversity, as indicated increase difficulty measure.

参考文章(23)
Richard Maclin, Jude W. Shavlik, Combining the predictions of multiple classifiers: using competitive learning to initialize neural networks international joint conference on artificial intelligence. pp. 524- 530 ,(1995)
Thomas G. Dietterich, Machine-Learning Research Ai Magazine. ,vol. 18, pp. 97- 136 ,(1997) , 10.1609/AIMAG.V18I4.1324
Thomas G. Dietterich, Ensemble Methods in Machine Learning Multiple Classifier Systems. pp. 1- 15 ,(2000) , 10.1007/3-540-45014-9_1
Janez Demšar, Statistical Comparisons of Classifiers over Multiple Data Sets Journal of Machine Learning Research. ,vol. 7, pp. 1- 30 ,(2006)
Nikunj C. Oza, Kagan Tumer, Input Decimation Ensembles: Decorrelation through Dimensionality Reduction multiple classifier systems. pp. 238- 247 ,(2001) , 10.1007/3-540-48219-9_24
Lorenza Saitta, Hypothesis Diversity in Ensemble Classification Lecture Notes in Computer Science. pp. 662- 670 ,(2006) , 10.1007/11875604_73
Ludmila I Kuncheva, Christopher J Whitaker, Ten measures of diversity in classifier ensembles: limits for two classifiers DERA/IEE Workshop Intelligent Sensor Processing. pp. 10- 10 ,(2001) , 10.1049/IC:20010105
Milton Friedman, The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance Journal of the American Statistical Association. ,vol. 32, pp. 675- 701 ,(1937) , 10.2307/2279372
YUVAL RAVIV, NATHAN INTRATOR, Bootstrapping with Noise: An Effective Regularization Technique Connection Science. ,vol. 8, pp. 355- 372 ,(1996) , 10.1080/095400996116811
David W Opitz, Jude W Shavlik, Actively Searching for an Effective Neural Network Ensemble Connection Science. ,vol. 8, pp. 337- 354 ,(1996) , 10.1080/095400996116802