Approximations for Binary Gaussian Process Classification

作者: Hannes Nickisch , Carl Edward Rasmussen

DOI:

关键词: MathematicsBinary classificationMarkov chain Monte CarloMachine learningAlgorithmApproximate inferenceProbabilistic logicGaussian processArtificial intelligenceModel selectionMarginal likelihoodExpectation propagation

摘要: We provide a comprehensive overview of many recent algorithms for approximate inference in Gaussian process models probabilistic binary classification. The relationships between several approaches are elucidated theoretically, and the properties different corroborated by experimental results. examine both 1) quality predictive distributions 2) suitability marginal likelihood approximations model selection (selecting hyperparameters) compare to gold standard based on MCMC. Interestingly, some methods produce good although their poor. Strong conclusions drawn about methods: Expectation Propagation algorithm is almost always method choice unless computational budget very tight. also extend existing various ways, unifying code implementing all approaches.

参考文章(25)
Radford M. Neal, Annealed importance sampling Statistics and Computing. ,vol. 11, pp. 125- 139 ,(2001) , 10.1023/A:1008923215028
Thomas P. Minka, Rosalind Picard, A family of algorithms for approximate bayesian inference Massachusetts Institute of Technology. ,(2001)
Thomas Minka, Divergence measures and message passing pp. 17- ,(2005)
Christopher K I Williams, Carl Edward Rasmussen, Gaussian Processes for Machine Learning ,(2005)
Malte Kuss, Carl Edward Rasmussen, Ralf Herbrich, Assessing Approximate Inference for Binary Gaussian Process Classification Journal of Machine Learning Research. ,vol. 6, pp. 1679- 1704 ,(2005) , 10.5555/1046920.1194901
Thomas P. Minka, Expectation propagation for approximate Bayesian inference uncertainty in artificial intelligence. pp. 362- 369 ,(2001)
Yasemin Altun, Thomas Hofmann, Alexander J Smola, None, Gaussian process classification for segmenting and annotating sequences Twenty-first international conference on Machine learning - ICML '04. pp. 4- ,(2004) , 10.1145/1015330.1015433
Mingjun Zhong, Fabien Lotte, Mark Girolami, Anatole Lécuyer, Classifying EEG for brain computer interfaces using Gaussian processes Pattern Recognition Letters. ,vol. 29, pp. 354- 359 ,(2008) , 10.1016/J.PATREC.2007.10.009
Manfred Opper, Cédric Archambeau, The variational gaussian approximation revisited Neural Computation. ,vol. 21, pp. 786- 792 ,(2009) , 10.1162/NECO.2008.08-07-592