Scalable Robust Matrix Recovery: Frank-Wolfe Meets Proximal Methods

作者: Cun Mu , Yuqian Zhang , John Wright , Donald Goldfarb

DOI: 10.1137/15M101628X

关键词:

摘要: Recovering matrices from compressive and grossly corrupted observations is a fundamental problem in robust statistics, with rich applications computer vision machine learning. In theory, under certain conditions, this can be solved polynomial time via natural convex relaxation, known as Compressive Principal Component Pursuit (CPCP). However, all existing provable algorithms for CPCP suffer superlinear per-iteration cost, which severely limits their applicability to large scale problems. paper, we propose provable, scalable efficient methods solve (essentially) linear cost. Our method combines classical ideas Frank-Wolfe proximal methods. each iteration, mainly exploit update the low-rank component rank-one SVD step sparse term. Convergence results implementation details are also discussed. We demonstrate scalability of proposed approach promising numerical experiments on visual data.

参考文章(39)
Martin Jaggi, Revisiting Frank-Wolfe: Projection-Free Sparse Convex Optimization international conference on machine learning. pp. 427- 435 ,(2013)
Zhouchen Lin, Arvind Ganesh, John Wright, Leqin Wu, Minming Chen, Yi Ma, None, Fast Convex Optimization Algorithms for Exact Recovery of a Corrupted Low-Rank Matrix Coordinated Science Laboratory, University of Illinois at Urbana-Champaign. ,(2009)
Lun Wu, Arvind Ganesh, Boxin Shi, Yasuyuki Matsushita, Yongtian Wang, Yi Ma, Robust photometric stereo via low-rank matrix completion and recovery asian conference on computer vision. pp. 703- 717 ,(2010) , 10.1007/978-3-642-19318-7_55
Martin Jaggi, Marek Sulovsky, A Simple Algorithm for Nuclear Norm Regularized Problems international conference on machine learning. pp. 471- 478 ,(2010)
Oleg Kuybeda, Gabriel A. Frank, Alberto Bartesaghi, Mario Borgnia, Sriram Subramaniam, Guillermo Sapiro, A collaborative framework for 3D alignment and classification of heterogeneous subvolumes in cryo-electron tomography Journal of Structural Biology. ,vol. 181, pp. 116- 127 ,(2013) , 10.1016/J.JSB.2012.10.010
J. Wright, Wenli Xu, Yi Ma, Yigang Peng, A. Ganesh, RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 34, pp. 2233- 2246 ,(2012) , 10.1109/TPAMI.2011.282
John Duchi, Shai Shalev-Shwartz, Yoram Singer, Tushar Chandra, Efficient projections onto thel1-ball for learning in high dimensions Proceedings of the 25th international conference on Machine learning - ICML '08. pp. 272- 279 ,(2008) , 10.1145/1390156.1390191
Shiqian Ma, Donald Goldfarb, Lifeng Chen, Fixed point and Bregman iterative methods for matrix rank minimization Mathematical Programming. ,vol. 128, pp. 321- 353 ,(2011) , 10.1007/S10107-009-0306-5
E.S. Levitin, B.T. Polyak, Constrained minimization methods USSR Computational Mathematics and Mathematical Physics. ,vol. 6, pp. 1- 50 ,(1966) , 10.1016/0041-5553(66)90114-5
Necdet Serhat Aybat, Donald Goldfarb, Shiqian Ma, Efficient algorithms for robust and stable principal component pursuit problems Computational Optimization and Applications. ,vol. 58, pp. 1- 29 ,(2014) , 10.1007/S10589-013-9613-0