Block Coordinate Descent for Sparse NMF

作者: Vince D. Calhoun , Sergey M. Plis , Vamsi K. Potluru , Thomas P. Hayes , Jonathan Le Roux

DOI:

关键词:

摘要: Nonnegative matrix factorization (NMF) has become a ubiquitous tool for data analysis. An important variant is the sparse NMF problem which arises when we explicitly require learnt features to be sparse. A natural measure of sparsity L$_0$ norm, however its optimization NP-hard. Mixed norms, such as L$_1$/L$_2$ measure, have been shown model robustly, based on intuitive attributes that measures need satisfy. This in contrast computationally cheaper alternatives plain L$_1$ norm. However, present algorithms designed optimizing mixed norm are slow and other formulations proposed those norms. Our algorithm allows us solve constraints while not sacrificing computation time. We experimental evidence real-world datasets shows our new performs an order magnitude faster compared current state-of-the-art solvers suitable large-scale datasets.

参考文章(27)
Kurt Stadlthanner, Toshihisa Tanaka, Fabian J. Theis, First results on uniqueness of sparse non-negative matrix factorization european signal processing conference. pp. 1- 4 ,(2005)
Xiaojing Ye, Yunmei Chen, Projection Onto A Simplex arXiv: Optimization and Control. ,(2011)
Daniel D. Lee, H. Sebastian Seung, Learning the parts of objects by non-negative matrix factorization Nature. ,vol. 401, pp. 788- 791 ,(1999) , 10.1038/44565
John Duchi, Shai Shalev-Shwartz, Yoram Singer, Tushar Chandra, Efficient projections onto thel1-ball for learning in high dimensions Proceedings of the 25th international conference on Machine learning - ICML '08. pp. 272- 279 ,(2008) , 10.1145/1390156.1390191
Wei Xu, Xin Liu, Yihong Gong, Document clustering based on non-negative matrix factorization international acm sigir conference on research and development in information retrieval. pp. 267- 273 ,(2003) , 10.1145/860435.860485
Michael W Berry, Murray Browne, Amy N Langville, V Paul Pauca, Robert J Plemmons, None, Algorithms and applications for approximate nonnegative matrix factorization Computational Statistics & Data Analysis. ,vol. 52, pp. 155- 173 ,(2007) , 10.1016/J.CSDA.2006.11.006
Cho-Jui Hsieh, Inderjit S. Dhillon, Fast coordinate descent methods with variable selection for non-negative matrix factorization Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '11. pp. 1064- 1072 ,(2011) , 10.1145/2020408.2020577
Andrzej CICHOCKI, Anh-Huy PHAN, Fast Local Algorithms for Large Scale Nonnegative Matrix and Tensor Factorizations IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences. ,vol. 92, pp. 708- 721 ,(2009) , 10.1587/TRANSFUN.E92.A.708
Chris Ding, Tao Li, Wei Peng, Haesun Park, Orthogonal nonnegative matrix t-factorizations for clustering knowledge discovery and data mining. pp. 126- 135 ,(2006) , 10.1145/1150402.1150420
Gershon Buchsbaum, Orin Bloch, Color categories revealed by non-negative matrix factorization of Munsell color spectra. Vision Research. ,vol. 42, pp. 559- 563 ,(2002) , 10.1016/S0042-6989(01)00303-0