Improving $K$ -Subspaces via Coherence Pursuit

作者: Andrew Gitlin , Biaoshuai Tao , Laura Balzano , John Lipor

DOI: 10.1109/JSTSP.2018.2869363

关键词: Linear subspaceComputer scienceSubspace topologyCluster analysisOutlierComputational complexity theorySynthetic dataAlgorithm designInitializationAlgorithm

摘要: Subspace clustering is a powerful generalization of for high-dimensional data analysis, where low-rank cluster structure leveraged accurate inference. $K$ -Subspaces (KSS), an alternating algorithm that mirrors -means, classical approach with this model. Like KSS highly sensitive to initialization, yet has two major handicaps beyond issue. First, unlike the objective NP-hard approximate within any finite factor large enough subspace rank. Second, it known $\ell _2$ estimation step faulty when estimated points from multiple subspaces. In paper, we demonstrate both these additional drawbacks, provide proof former, and offer solution latter through use robust recovery (RSR) method as coherence pursuit (CoP). While many RSR methods have been developed in recent years, few can handle case outliers are themselves low We prove CoP outliers. This its computational complexity make ideal incorporate into KSS. on synthetic successfully rejects show combining yields state-of-the-art performance canonical benchmark datasets.

参考文章(43)
Yi Ma, S. S. Sastry, Ren Vidal, Generalized Principal Component Analysis ,(2016)
P.S. Bradley, O.L. Mangasarian, k-Plane Clustering Journal of Global Optimization. ,vol. 16, pp. 23- 32 ,(2000) , 10.1023/A:1008324625522
P. Tseng, Nearest q-Flat to m Points Journal of Optimization Theory and Applications. ,vol. 105, pp. 249- 252 ,(2000) , 10.1023/A:1004678431677
Ali Kemal Sinop, Moses Charikar, Pranjal Awasthi, Ravishankar Krishnaswamy, The Hardness of Approximation of Euclidean k-means arXiv: Computational Complexity. ,(2015)
E. Elhamifar, R. Vidal, Sparse Subspace Clustering: Algorithm, Theory, and Applications IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 35, pp. 2765- 2781 ,(2013) , 10.1109/TPAMI.2013.57
Huan Xu, Constantine Caramanis, Sujay Sanghavi, Robust PCA via Outlier Pursuit IEEE Transactions on Information Theory. ,vol. 58, pp. 3047- 3064 ,(2012) , 10.1109/TIT.2011.2173156
Vladimir Rokhlin, Arthur Szlam, Mark Tygert, A Randomized Algorithm for Principal Component Analysis SIAM Journal on Matrix Analysis and Applications. ,vol. 31, pp. 1100- 1124 ,(2010) , 10.1137/080736417
Roberto Tron, Rene Vidal, A Benchmark for the Comparison of 3-D Motion Segmentation Algorithms computer vision and pattern recognition. pp. 1- 8 ,(2007) , 10.1109/CVPR.2007.382974
J Paul Brooks, José H Dulá, Edward L Boone, A pure L 1 -norm principal component analysis Computational Statistics & Data Analysis. ,vol. 61, pp. 83- 98 ,(2013) , 10.1016/J.CSDA.2012.11.007
Joan Bruna, S. Mallat, Invariant Scattering Convolution Networks IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 35, pp. 1872- 1886 ,(2013) , 10.1109/TPAMI.2012.230