A low-cost variational-Bayes technique for merging mixtures of probabilistic principal component analyzers

作者: Pierrick Bruneau , Marc Gelgon , Fabien Picarougne

DOI: 10.1016/J.INFFUS.2012.08.005

关键词:

摘要: Mixtures of probabilistic principal component analyzers (MPPCA) have shown effective for modeling high-dimensional data sets living on non-linear manifolds. Briefly stated, they conduct mixture model estimation and dimensionality reduction through a single process. This paper makes two contributions: first, we disclose Bayesian technique estimating such models. Then, assuming several MPPCA models are available, address the problem aggregating them into model, which should be as parsimonious possible. We in detail how this can achieved cost-effective way, without sampling nor access to data, but solely requiring parameters. The proposed approach is based novel variational-Bayes scheme operating over Numerous experimental results discussion provided.

参考文章(35)
Václav Šmídl, Anthony Quinn, The Variational Bayes Method in Signal Processing ,(2005)
Semi-Supervised Learning Advanced Methods in Sequence Analysis Lectures. pp. 221- 232 ,(2010) , 10.7551/MITPRESS/9780262033589.001.0001
Christopher M. Bishop, Pattern Recognition and Machine Learning (Information Science and Statistics) Springer-Verlag New York, Inc.. ,(2006)
Michael I Jordan, Zoubin Ghahramani, Tommi S Jaakkola, Lawrence K Saul, None, An introduction to variational methods for graphical models Machine Learning. ,vol. 37, pp. 105- 161 ,(1999) , 10.1023/A:1007665907178
J McLachlan, G, D. Peel, Finite Mixture Models ,(2000)
Christopher M. Bishop, Pattern Recognition and Machine Learning ,(2006)
E. B. Fowlkes, C. L. Mallows, A Method for Comparing Two Hierarchical Clusterings Journal of the American Statistical Association. ,vol. 78, pp. 553- 569 ,(1983) , 10.1080/01621459.1983.10478008
A. P. Dempster, N. M. Laird, D. B. Rubin, Maximum Likelihood from Incomplete Data Via theEMAlgorithm Journal of the Royal Statistical Society: Series B (Methodological). ,vol. 39, pp. 1- 22 ,(1977) , 10.1111/J.2517-6161.1977.TB01600.X
B. Safarinejadian, M.B. Menhaj, M. Karrari, Distributed variational Bayesian algorithms for Gaussian mixtures in sensor networks Signal Processing. ,vol. 90, pp. 1197- 1208 ,(2010) , 10.1016/J.SIGPRO.2009.10.004
Pierrick Bruneau, Marc Gelgon, Fabien Picarougne, Parsimonious reduction of Gaussian mixture models with a variational-Bayes approach Pattern Recognition. ,vol. 43, pp. 850- 858 ,(2010) , 10.1016/J.PATCOG.2009.08.006