Improving over-fitting in ensemble regression by imprecise probabilities

作者: Lev V. Utkin , Andrea Wiencierz

DOI: 10.1016/J.INS.2015.04.037

关键词:

摘要: In this paper, generalized versions of two ensemble methods for regression based on variants the original AdaBoost algorithm are proposed. The generalization these consists in restricting unit simplex weights instances to a smaller set weighting probabilities. Various imprecise statistical models can be used obtain restricted probabilities, whose sizes each depend single parameter. For particular choices parameter, proposed algorithms reduce standard AdaBoost-based or regression. main advantage compared basic is that they have less tendency over-fitting, because hard restricted. Several simulations and applications furthermore indicate better performance comparison with corresponding methods.

参考文章(33)
Lev V Utkin, FRANK PA COOLEN, On Reliability Growth Models Using Kolmogorov-Smirnov Bounds International journal of performability engineering. ,vol. 7, pp. 5- ,(2011)
Li Li, Support Vector Machines Springer, Berlin, Heidelberg. pp. 17- 52 ,(2015) , 10.1007/978-3-662-46356-7_2
Balázs Kégl, Robust Regression by Boosting the Median Learning Theory and Kernel Machines. pp. 258- 272 ,(2003) , 10.1007/978-3-540-45167-9_20
James Franklin, The elements of statistical learning : data mining, inference,and prediction The Mathematical Intelligencer. ,vol. 27, pp. 83- 85 ,(2005) , 10.1007/BF02985802
Harris Drucker, Improving Regressors using Boosting Techniques international conference on machine learning. pp. 107- 115 ,(1997)
Larry Wasserman, All of Nonparametric Statistics ,(2008)
Artur J. Ferreira, Mário A. T. Figueiredo, Boosting Algorithms: A Review of Methods, Theory, and Applications Ensemble Machine Learning: Methods and Applications. pp. 35- 85 ,(2012) , 10.1007/978-1-4419-9326-7_2
Jerome H. Friedman, Greedy function approximation: A gradient boosting machine. Annals of Statistics. ,vol. 29, pp. 1189- 1232 ,(2001) , 10.1214/AOS/1013203451
陳佩君, Support Vector Machines ,(2008)
Alex J. Smola, Bernhard Schölkopf, A tutorial on support vector regression Statistics and Computing. ,vol. 14, pp. 199- 222 ,(2004) , 10.1023/B:STCO.0000035301.49549.88