Bayesian neural networks for classification: how useful is the evidence framework

作者: W.D. Penny , S.J. Roberts

DOI: 10.1016/S0893-6080(99)00040-4

关键词:

摘要: This paper presents an empirical assessment of the Bayesian evidence framework for neural networks using four synthetic and real-world classification problems. We focus on three issues; model selection, automatic relevance determination (ARD) use committees. Model selection criterion is only tenable if number training examples exceeds network weights by a factor five or ten. With this available examples, however, cross-validation viable alternative. The ARD feature scheme useful in with many hidden units data sets containing irrelevant variables. also as hard method. Results applying to showed that committees achieved accuracies similar best alternative methods. Importantly, was achievable minimum human intervention.

参考文章(19)
A. M. Walker, On the Asymptotic Behaviour of Posterior Distributions Journal of the Royal Statistical Society: Series B (Methodological). ,vol. 31, pp. 80- 88 ,(1969) , 10.1111/J.2517-6161.1969.TB00767.X
B. D. Ripley, Neural Networks and Related Methods for Classification Journal of the Royal Statistical Society: Series B (Methodological). ,vol. 56, pp. 409- 437 ,(1994) , 10.1111/J.2517-6161.1994.TB01990.X
Steffen Gutjahr, Christian Nautze, Extended Bayesian learning. the european symposium on artificial neural networks. ,(1997)
Christopher M. Bishop, Neural networks for pattern recognition ,(1995)
Geoffrey Hinton, Radford M. Neal, Bayesian learning for neural networks ,(1995)
Radford M. Neal, Monte Carlo Implementation of Gaussian Process Models for Bayesian Regression and Classification arXiv: Data Analysis, Statistics and Probability. ,(1997)
J.M. Spyers-Ashby, P.G. Bain, S.J. Roberts, A comparison of fast fourier transform (FFT) and autoregressive (AR) spectral estimation techniques for the analysis of tremor data Journal of Neuroscience Methods. ,vol. 83, pp. 35- 43 ,(1998) , 10.1016/S0165-0270(98)00064-8
Peter M. Williams, Bayesian regularization and pruning using a Laplace prior Neural Computation. ,vol. 7, pp. 117- 143 ,(1995) , 10.1162/NECO.1995.7.1.117
H.H. Thodberg, A review of Bayesian neural networks with an application to near infrared spectroscopy IEEE Transactions on Neural Networks. ,vol. 7, pp. 56- 72 ,(1996) , 10.1109/72.478392