Negative Binomial Process Count and Mixture Modeling

作者: Mingyuan Zhou , Lawrence Carin

DOI: 10.1109/TPAMI.2013.211

关键词:

摘要: The seemingly disjoint problems of count and mixture modeling are united under the negative binomial (NB) process. A gamma process is employed to model rate measure a Poisson process, whose normalization provides random probability for marginalization leads an NB modeling. draw from consists distributed finite number distinct atoms, each which associated with logarithmic data samples. We reveal relationships between various count- mixture-modeling distributions construct Poisson-logarithmic bivariate distribution that connects Chinese restaurant table distributions. Fundamental properties models developed, we derive efficient Bayesian inference. It shown augmentation normalization, gamma-NB can be reduced Dirichlet hierarchical respectively. These highlight theoretical, structural, computational advantages variety processes, including beta-geometric, beta-NB, marked-beta-NB, marked-gamma-NB zero-inflated-NB sharing mechanisms, also constructed. applied topic modeling, connections made existing algorithms factor analysis. Example results show importance inferring both dispersion parameters.

参考文章(73)
David J. Aldous, Exchangeability and related topics Lecture Notes in Mathematics. ,vol. 1117, pp. 1- 198 ,(1985) , 10.1007/BFB0099421
Romain Thibaux, Michael I Jordan, None, Hierarchical Beta Processes and the Indian Buffet Process international conference on artificial intelligence and statistics. pp. 564- 571 ,(2007)
Yee Whye Teh, Dilan Grür, Zoubin Ghahramani, None, Stick-breaking Construction for the Indian Buffet Process international conference on artificial intelligence and statistics. pp. 556- 563 ,(2007)
Romain Jean Thibaux, Michael I. Jordan, Nonparametric bayesian models for machine learning University of California at Berkeley. ,(2008)
Combinatorial Stochastic Processes Springer-Verlag. ,vol. 1875, ,(2006) , 10.1007/B11601500
Rainer Winkelmann, Econometric Analysis of Count Data ,(1997)
Thomas Hofmann, Probabilistic latent semantic analysis uncertainty in artificial intelligence. ,vol. 15, pp. 289- 296 ,(1999)
David Knowles, Zoubin Ghahramani, None, Infinite Sparse Factor Analysis and Infinite Independent Components Analysis Independent Component Analysis and Signal Separation. pp. 381- 388 ,(2007) , 10.1007/978-3-540-74494-8_48
David M Blei, Andrew Y Ng, Michael I Jordan, None, Latent dirichlet allocation Journal of Machine Learning Research. ,vol. 3, pp. 993- 1022 ,(2003) , 10.5555/944919.944937
Wray Buntine, Aleks Jakulin, Discrete Component Analysis Subspace, Latent Structure and Feature Selection. pp. 1- 33 ,(2006) , 10.1007/11752790_1