A multi-objective approach to RBF network learning

作者: Illya Kokshenev , Antonio Padua Braga

DOI: 10.1016/J.NEUCOM.2007.11.021

关键词:

摘要: The problem of inductive supervised learning is discussed in this paper within the context multi-objective (MOBJ) optimization. smoothness-based apparent (effective) complexity measure for RBF networks considered. For specific case network, bounds on are formally described. As synthetic and real-world data experiments show, proposed MOBJ method capable efficient generalization control along with network size reduction.

参考文章(19)
H. L. Le Roy, L. Lecam, J. Neyman, Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability; Vol. IV Revue de l'Institut International de Statistique / Review of the International Statistical Institute. ,vol. 37, pp. 230- ,(1969) , 10.2307/1402306
J. Yang, J. Whidborne, G. Liu, Multi-objective Optimisation and Control Research Studies Press Limited; 2002.. ,(2002)
Antônio Pádua Braga, Ricardo H. C. Takahashi, Marcelo Azevedo Costa, Roselito de Albuquerque Teixeira, Multi-Objective Algorithms for Neural Networks Learning Multi-Objective Machine Learning. pp. 151- 171 ,(2006) , 10.1007/3-540-33019-4_7
Yaochu Jin, Multi-objective machine learning Springer Verlag. ,(2006) , 10.1007/3-540-33019-4
Yaochu Jin, T. Okabe, B. Sendhoff, Neural network regularization and ensembling using multi-objective evolutionary algorithms Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753). ,vol. 1, pp. 1- 8 ,(2004) , 10.1109/CEC.2004.1330830
Federico Girosi, Michael Jones, Tomaso Poggio, Regularization theory and neural networks architectures Neural Computation. ,vol. 7, pp. 219- 269 ,(1995) , 10.1162/NECO.1995.7.2.219
A Tikhonov, Solution of incorrectly formulated problems and the regularization method Soviet Math. Dokl.. ,vol. 5, pp. 1035- 1038 ,(1963)
Roselito de Albuquerque Teixeira, Antônio Pádua Braga, Ricardo H.C. Takahashi, Rodney R. Saldanha, Improving generalization of MLPs with multi-objective optimization Neurocomputing. ,vol. 35, pp. 189- 194 ,(2000) , 10.1016/S0925-2312(00)00327-1
Robert Tibshirani, Trevor Hastie, Berwin A. Turlach, Bradley Efron, Jean Michel Loubes, Jean Michel Loubes, Hemant Ishwaran, Robert A. Stine, Keith Knight, Sanford Weisberg, Saharon Rosset, Saharon Rosset, Iain Johnstone, Pascal Massart, Pascal Massart, David Madigan, J. I. Zhu, Greg Ridgeway, Greg Ridgeway, Least angle regression Annals of Statistics. ,vol. 32, pp. 407- 499 ,(2004) , 10.1214/009053604000000067
Stuart Geman, Elie Bienenstock, René Doursat, Neural networks and the bias/variance dilemma Neural Computation. ,vol. 4, pp. 1- 58 ,(1992) , 10.1162/NECO.1992.4.1.1