Quantifying Point-Prediction Uncertainty in Neural Networks via Residual Estimation with an I/O Kernel

作者: Risto Miikkulainen , Xin Qiu , Elliot Meyerson

DOI:

关键词: Artificial intelligenceComputer sciencePipeline (computing)Scale (ratio)Gaussian processRegressionMachine learningBayesian probabilityArtificial neural networkKernel (statistics)Residual

摘要: Neural Networks (NNs) have been extensively used for a wide spectrum of real-world regression tasks, where the goal is to predict a numerical outcome such as revenue, effectiveness, or a quantitative result. In many such tasks, the point prediction is not enough: the uncertainty (ie risk or confidence) of that prediction must also be estimated. Standard NNs, which are most often used in such tasks, do not provide uncertainty information. Existing approaches address this issue by combining Bayesian models with NNs, but these …

参考文章(42)
Michalis K. Titsias, Variational Learning of Inducing Variables in Sparse Gaussian Processes. international conference on artificial intelligence and statistics. pp. 567- 574 ,(2009)
Christopher K. I. Williams, Carl Edward Rasmussen, Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning) The MIT Press. ,(2005)
Zoubin Ghahramani, None, Probabilistic machine learning and artificial intelligence Nature. ,vol. 521, pp. 452- 459 ,(2015) , 10.1038/NATURE14541
Neil D. Lawrence, Matthias W. Seeger, Christopher K. I. Williams, Fast Forward Selection to Speed Up Sparse Gaussian Process Regression international conference on artificial intelligence and statistics. ,(2003)
J. Močkus, On bayesian methods for seeking the extremum Optimization Techniques IFIP Technical Conference Novosibirsk, July 1–7, 1974. pp. 400- 404 ,(1975) , 10.1007/3-540-07165-2_55
Zoubin Ghahramani, James Hensman, Alexander G. de G. Matthews, Scalable Variational Gaussian Process Classification international conference on artificial intelligence and statistics. pp. 351- 360 ,(2015)
Geoffrey Hinton, Radford M. Neal, Bayesian learning for neural networks ,(1995)
Carl Edward Rasmussen, Joaquin Quiñonero-Candela, A Unifying View of Sparse Approximate Gaussian Process Regression Journal of Machine Learning Research. ,vol. 6, pp. 1939- 1959 ,(2005) , 10.5555/1046920.1194909
Neil D. Lawrence, James Hensman, Nicolò Fusi, Gaussian processes for Big data uncertainty in artificial intelligence. ,vol. 29, pp. 282- 290 ,(2013)
Tin Kam Ho, Random decision forests international conference on document analysis and recognition. ,vol. 1, pp. 278- 282 ,(1995) , 10.1109/ICDAR.1995.598994