Ranking from Crowdsourced Pairwise Comparisons via Smoothed Matrix Manifold Optimization

作者: Jialin Dong , Kai Yang , Yuanming Shi

DOI: 10.1109/ICDMW.2017.130

关键词: Matrix (mathematics)Constraint (information theory)Pairwise comparisonUniform normComputer scienceParametric modelStatistical inferenceMathematical optimizationManifoldOptimization problemMaximum likelihoodRankingQuotientApproximation algorithmData modeling

摘要: As the blooming development of data mining in social computing systems (e.g., crowdsourcing system), statistical inference from crowdsourced severs as a powerful tool to provide diversified services. To support critical applications recommendation), this paper, we shall focus on collaborative ranking problems and construct system which input is pairwise comparisons output individual rankings. Under Bradley-Terry-Luce (BTL) parametric model assumption, present maximum likelihood estimation (MLE) based low-rank approach estimate underlying weight/score matrix, thereby predicting for each user. address unique challenge coupled non-convex constraint non-smooth elementwise infinity norm resulting MLE problem, propose novel regularized formulation with smoothed surrogate norm. By further exploiting geometry quotient manifolds fixed-rank matrices, solve rank-constrained optimization problem via developing Riemannian trust-region algorithm converges an approximate local minimum arbitrary initial points. Numerical results demonstrate extraordinary effectiveness proposed method compared state-of-art algorithms.

参考文章(37)
Rodolphe Sepulchre, Gilles Meyer, Silv re Bonnabel, Linear Regression under Fixed-Rank Constraints: A Riemannian Approach international conference on machine learning. pp. 545- 552 ,(2011)
Joe Neeman, Inderjit Dhillon, Sujay Sanghavi, Dohyung Park, Jin Zhang, Preference Completion: Large-scale Collaborative Ranking from Pairwise Comparisons international conference on machine learning. pp. 1907- 1916 ,(2015)
R. Sepulchre, R. Mahony, P.-A. Absil, Optimization Algorithms on Matrix Manifolds ,(2007)
Ivan Dokmanic, Reza Parhizkar, Juri Ranieri, Martin Vetterli, Euclidean Distance Matrices: Essential theory, algorithms, and applications IEEE Signal Processing Magazine. ,vol. 32, pp. 12- 30 ,(2015) , 10.1109/MSP.2015.2398954
Amir Beck, Marc Teboulle, Smoothing and First Order Methods: A Unified Framework Siam Journal on Optimization. ,vol. 22, pp. 557- 580 ,(2012) , 10.1137/100818327
Jasson D. M. Rennie, Nathan Srebro, Fast maximum margin matrix factorization for collaborative prediction Proceedings of the 22nd international conference on Machine learning - ICML '05. pp. 713- 719 ,(2005) , 10.1145/1102351.1102441
RALPH ALLAN BRADLEY, MILTON E. TERRY, RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS THE METHOD OF PAIRED COMPARISONS Biometrika. ,vol. 39, pp. 324- 345 ,(1952) , 10.1093/BIOMET/39.3-4.324
Jingbo Zhu, Chunliang Zhang, Matthew Y. Ma, Multi-Aspect Rating Inference with Aspect-Based Segmentation IEEE Transactions on Affective Computing. ,vol. 3, pp. 469- 481 ,(2012) , 10.1109/T-AFFC.2012.18
Bamdev Mishra, Gilles Meyer, Silvère Bonnabel, Rodolphe Sepulchre, Fixed-rank matrix factorizations and Riemannian low-rank optimization Computational Statistics. ,vol. 29, pp. 591- 621 ,(2014) , 10.1007/S00180-013-0464-Z
Sonia A. Bhaskar, Adel Javanmard, 1-bit matrix completion under exact low-rank constraint conference on information sciences and systems. pp. 1- 6 ,(2015) , 10.1109/CISS.2015.7086879