Guaranteed Rank Minimization via Singular Value Projection

作者: Inderjit S. Dhillon , Prateek Jain , Raghu Meka

DOI:

关键词:

摘要: Minimizing the rank of a matrix subject to affine constraints is fundamental problem with many important applications in machine learning and statistics. In this paper we propose simple fast algorithm SVP (Singular Value Projection) for minimization under (ARMP) show that recovers minimum solution satisfy restricted isometry property (RIP). Our method guarantees geometric convergence rate even presence noise requires strictly weaker assumptions on RIP constants than existing methods. We also introduce Newton-step our framework speed-up substantial empirical gains. Next, address practically application ARMP - low-rank completion, which defining do not directly obey RIP, hence hold. However, provide partial progress towards proof exact recovery by showing more observe empirically incoherent matrices from an almost optimal number uniformly sampled entries. demonstrate algorithms outperform methods, such as those [5, 18, 14], completion order magnitude are robust sampling schemes. particular, results SVP-Newton significantly performs impressively realistic power-law scheme problem.

参考文章(33)
R. B. Lehoucq, D. C. Sorensen, C. Yang, ARPACK Users' Guide: Solution of Large-Scale Eigenvalue Problems with Implicitly Restarted Arnoldi Methods Society for Industrial and Applied Mathematics. ,(1998) , 10.1137/1.9780898719628
Maryam Fazel, Haitham Hindi, Stephen P Boyd, None, Log-det heuristic for matrix rank minimization with applications to Hankel and Euclidean distance matrices american control conference. ,vol. 3, pp. 2156- 2162 ,(2003) , 10.1109/ACC.2003.1243393
M. Fazel, H. Hindi, S.P. Boyd, A rank minimization heuristic with application to minimum order system approximation american control conference. ,vol. 6, pp. 4734- 4739 ,(2001) , 10.1109/ACC.2001.945730
Yehuda Koren, Factorization meets the neighborhood Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD 08. pp. 426- 434 ,(2008) , 10.1145/1401890.1401944
Shuiwang Ji, Jieping Ye, An accelerated gradient method for trace norm minimization Proceedings of the 26th Annual International Conference on Machine Learning - ICML '09. pp. 457- 464 ,(2009) , 10.1145/1553374.1553434
Raghunandan H. Keshavan, Sewoong Oh, Andrea Montanari, Matrix completion from a few entries 2009 IEEE International Symposium on Information Theory. pp. 324- 328 ,(2009) , 10.1109/ISIT.2009.5205567
Shiqian Ma, Donald Goldfarb, Lifeng Chen, Fixed point and Bregman iterative methods for matrix rank minimization Mathematical Programming. ,vol. 128, pp. 321- 353 ,(2011) , 10.1007/S10107-009-0306-5
Raghu Meka, Prateek Jain, Constantine Caramanis, Inderjit S. Dhillon, Rank minimization via online learning Proceedings of the 25th international conference on Machine learning - ICML '08. pp. 656- 663 ,(2008) , 10.1145/1390156.1390239
Venkat Chandrasekaran, Sujay Sanghavi, Pablo A. Parrilo, Alan S. Willsky, Sparse and Low-Rank Matrix Decompositions IFAC Proceedings Volumes. ,vol. 42, pp. 1493- 1498 ,(2009) , 10.3182/20090706-3-FR-2004.00249