Nonnegative matrix factorization and I-divergence alternating minimization☆

作者: Lorenzo Finesso , Peter Spreij

DOI: 10.1016/J.LAA.2005.11.012

关键词:

摘要: Abstract In this paper we consider the Nonnegative Matrix Factorization (NMF) problem: given an (elementwise) nonnegative matrix V ∈ R + m × n find, for assigned k, matrices W k and H such that V = WH. Exact, nontrivial, factorizations do not always exist, hence it is interesting to pose approximate NMF problem. The criterion which commonly employed I-divergence between matrices. problem becomes of finding, factorization WH closest in I-divergence. An iterative algorithm, EM like, construction best pair (W, H) has been proposed literature. interpret algorithm as alternating minimization procedure a la Csiszar–Tusnady investigate some its stability properties. widespreading data analysis method applications positivity constraint relevant. There are other methods impose form nonnegativity: discuss here connections Archetypal Analysis.

参考文章(13)
G. Picci, J. H. van Schuppen, On the weak finite stochastic realization problem Lecture Notes in Control and Information Sciences. pp. 237- 242 ,(1984) , 10.1007/BFB0006573
Michiel Hazewinkel, On positive vectors, positive matrices and the specialization order Department of Pure Mathematics. pp. 1- 11 ,(1984)
Daniel D. Lee, H. Sebastian Seung, Learning the parts of objects by non-negative matrix factorization Nature. ,vol. 401, pp. 788- 791 ,(1999) , 10.1038/44565
David W. Peterson, Willard I. Zangwill, Nonlinear programming : a unified approach Econometrica. ,vol. 40, pp. 411- ,(1972) , 10.2307/1909424
A. P. Dempster, N. M. Laird, D. B. Rubin, Maximum Likelihood from Incomplete Data Via theEMAlgorithm Journal of the Royal Statistical Society: Series B (Methodological). ,vol. 39, pp. 1- 22 ,(1977) , 10.1111/J.2517-6161.1977.TB01600.X
C. F. Jeff Wu, ON THE CONVERGENCE PROPERTIES OF THE EM ALGORITHM Annals of Statistics. ,vol. 11, pp. 95- 103 ,(1983) , 10.1214/AOS/1176346060
M. Catral, Lixing Han, Michael Neumann, R.J. Plemmons, On reduced rank nonnegative matrix factorization for symmetric nonnegative matrices Linear Algebra and its Applications. ,vol. 393, pp. 107- 126 ,(2004) , 10.1016/J.LAA.2003.11.024
J.A. O'Sullivan, Properties of the information value decomposition international symposium on information theory. pp. 491- ,(2000) , 10.1109/ISIT.2000.866789
G. Picci, J.M. van den Hof, J.H. van Schuppen, Primes in several classes of the positive matrices Linear Algebra and its Applications. ,vol. 277, pp. 149- 185 ,(1998) , 10.1016/S0024-3795(97)10060-X