Csiszár’s Divergences for Non-negative Matrix Factorization: Family of New Algorithms

作者: Andrzej Cichocki , Rafal Zdunek , Shun-ichi Amari

DOI: 10.1007/11679363_5

关键词: Sparse approximationAlgorithmSmoothness (probability theory)Non-negative matrix factorizationComputer scienceSource separationIndependent component analysisRobustness (computer science)Blind signal separationPrincipal component analysisOutlierDivergence (statistics)Matrix decompositionDivergenceRegularization (mathematics)Generalized function

摘要: In this paper we discus a wide class of loss (cost) functions for non-negative matrix factorization (NMF) and derive several novel algorithms with improved efficiency and robustness to …

参考文章(10)
Shun-ichi Amari, Andrzej Cichocki, Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications John Wiley & Sons, Inc.. ,(2002)
Daniel D. Lee, H. Sebastian Seung, Learning the parts of objects by non-negative matrix factorization Nature. ,vol. 401, pp. 788- 791 ,(1999) , 10.1038/44565
Shun-ichi Amari, Information geometry of the EM and em algorithms for neural networks Neural Networks. ,vol. 8, pp. 1379- 1408 ,(1995) , 10.1016/0893-6080(95)00003-8
Raul Kompass, A Generalized Divergence Measure for Nonnegative Matrix Factorization Neural Computation. ,vol. 19, pp. 780- 791 ,(2007) , 10.1162/NECO.2007.19.3.780
Noel A. C. Cressie, Timothy R. C. Read, Goodness-of-Fit Statistics for Discrete Multivariate Data ,(1988)
Paul Sajda, Shuyan Du, Lucas C. Parra, Recovery of constituent spectra using non-negative matrix factorization Optical Science and Technology, SPIE's 48th Annual Meeting. ,vol. 5207, pp. 321- 331 ,(2003) , 10.1117/12.504676
Patrik O. Hoyer, Non-negative Matrix Factorization with Sparseness Constraints Journal of Machine Learning Research. ,vol. 5, pp. 1457- 1469 ,(2004) , 10.5555/1005332.1044709
C.L. Byrne, Accelerating the EMML algorithm and related iterative algorithms by rescaled block-iterative methods IEEE Transactions on Image Processing. ,vol. 7, pp. 100- 109 ,(1998) , 10.1109/83.650854
Yong-Choon Cho, Seungjin Choi, Nonnegative features of spectro-temporal sounds for classification Pattern Recognition Letters. ,vol. 26, pp. 1327- 1336 ,(2005) , 10.1016/J.PATREC.2004.11.026