Online Low-Rank Metric Learning via Parallel Coordinate Descent Method

作者: Gan Sun , Yang Cong , Qiang Wang , Xiaowei Xu

DOI: 10.1109/ICPR.2018.8546239

关键词:

摘要: 11The corresponding author is Prof. Yang Cong. This work supported by Nature Science Foundation of China under Grant (61722311, U1613214, 61533015) and CAS-Youth Innovation Promotion Association Scholarship (2012163)Recently, many machine learning problems rely on a valuable tool: metric learning. However, in applications, large-scale applications embedded high-dimensional feature space may induce both computation storage requirements to grow quadratically. In order tackle these challenges, this paper, we intend establish robust formulation with the expectation that online parallel optimization can solve data efficiently, respectively. Specifically, based matrix factorization strategy, first step aims learn similarity function objective for measurement; second step, derive variational trace norm promote low-rankness transformation matrix. After converting regularization into its separable form, model optimization, present an block coordinate descent method optimal parameters, which handle efficient way. Crucially, our shares efficiency flexibility method, it also guaranteed converge solution. Finally, evaluate approach analyzing scene categorization dataset tens thousands dimensions, experimental results show effectiveness proposed model.

参考文章(23)
Peipei Yang, Kaizhu Huang, Cheng-Lin Liu, Multi-task low-rank metric learning based on common subspace international conference on neural information processing. pp. 151- 159 ,(2011) , 10.1007/978-3-642-24958-7_18
Amaury Habrard, Aurélien Bellet, Marc Sebban, A Survey on Metric Learning for Feature Vectors and Structured Data arXiv: Learning. ,(2013)
Steven CH Hoi, Wei Liu, Shih-Fu Chang, None, Semi-supervised distance metric learning for collaborative image retrieval and clustering ACM Transactions on Multimedia Computing, Communications, and Applications. ,vol. 6, pp. 18- ,(2010) , 10.1145/1823746.1823752
Yong Luo, Tongliang Liu, Dacheng Tao, Chao Xu, Decomposition-Based Transfer Distance Metric Learning for Image Classification IEEE Transactions on Image Processing. ,vol. 23, pp. 3789- 3801 ,(2014) , 10.1109/TIP.2014.2332398
Kilian Q. Weinberger, Lawrence K. Saul, Fast solvers and efficient implementations for distance metric learning Proceedings of the 25th international conference on Machine learning - ICML '08. pp. 1160- 1167 ,(2008) , 10.1145/1390156.1390302
T. Mensink, J. Verbeek, F. Perronnin, G. Csurka, Distance-Based Image Classification: Generalizing to New Classes at Near-Zero Cost IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 35, pp. 2624- 2637 ,(2013) , 10.1109/TPAMI.2013.83
Andreas Argyriou, Theodoros Evgeniou, Massimiliano Pontil, Convex multi-task feature learning Machine Learning. ,vol. 73, pp. 243- 272 ,(2008) , 10.1007/S10994-007-5040-8
Guoqiang Zhong, Kaizhu Huang, Cheng-Lin Liu, Low Rank Metric Learning with Manifold Regularization international conference on data mining. pp. 1266- 1271 ,(2011) , 10.1109/ICDM.2011.95
Yang Cong, Ji Liu, Junsong Yuan, Jiebo Luo, Self-Supervised Online Metric Learning With Low Rank Constraint for Scene Categorization IEEE Transactions on Image Processing. ,vol. 22, pp. 3179- 3191 ,(2013) , 10.1109/TIP.2013.2260168
Amir Globerson, Sam T. Roweis, Metric Learning by Collapsing Classes neural information processing systems. ,vol. 18, pp. 451- 458 ,(2005)