Decision-Theoretic Sparsification for Gaussian Process Preference Learning

作者: M. Ehsan Abbasnejad , Edwin V. Bonilla , Scott Sanner

DOI: 10.1007/978-3-642-40991-2_33

关键词:

摘要: We propose a decision-theoretic sparsification method for Gaussian process preference learning. This overcomes the loss-insensitive nature of popular approaches such as Informative Vector Machine (IVM). Instead selecting subset users and items inducing points based on uncertainty-reduction principles, our approach is underpinned by decision theory directly incorporates loss function inherent to underlying learning problem. show that different specifications function, IVM's differential entropy criterion, value information an upper confidence bound (UCB) criterion used in bandit setting can all be recovered from framework. refer Valuable (VVM) it selects most useful during minimize corresponding loss. evaluate one synthetic two real-world datasets, including generated via Amazon Mechanical Turk another collected Facebook. Experiments variants VVM significantly outperform IVM datasets under similar computational constraints.

参考文章(33)
Daphne Koller, Urszula Chajewska, Utilities as random variables: density estimation and structure discovery uncertainty in artificial intelligence. pp. 63- 71 ,(2000)
Thomas P. Minka, Rosalind Picard, A family of algorithms for approximate bayesian inference Massachusetts Institute of Technology. ,(2001)
Zhao Xu, Kristian Kersting, Thorsten Joachims, Fast active exploration for link-based preference learning using Gaussian processes european conference on machine learning. pp. 499- 514 ,(2010) , 10.1007/978-3-642-15939-8_32
Carl Edward Rasmussen, Joaquin Quiñonero-Candela, A Unifying View of Sparse Approximate Gaussian Process Regression Journal of Machine Learning Research. ,vol. 6, pp. 1939- 1959 ,(2005) , 10.5555/1046920.1194909
Shengbo Guo, Scott Sanner, Multiattribute bayesian preference elicitation with pairwise comparison queries international symposium on neural networks. pp. 396- 403 ,(2010) , 10.1007/978-3-642-13278-0_51
Christopher K I Williams, Carl Edward Rasmussen, Gaussian Processes for Machine Learning ,(2005)
Tarek Abudawood, Peter Flach, Evaluation Measures for Multi-class Subgroup Discovery european conference on machine learning. pp. 35- 50 ,(2009) , 10.1007/978-3-642-04180-8_20
Neil Houlsby, Ferenc Huszár, Zoubin Ghahramani, Máté Lengyel, None, Bayesian Active Learning for Classification and Preference Learning arXiv: Machine Learning. ,(2011)