Deterministic annealing EM algorithm

作者: Naonori Ueda , Ryohei Nakano

DOI: 10.1016/S0893-6080(97)00133-0

关键词: Mixture modelArtificial neural networkAlgorithmMathematical optimizationSimulated annealingMathematicsMaxima and minimaStatistical modelExpectation–maximization algorithmProbabilistic logicPrinciple of maximum entropy

摘要: … a deterministic annealing variant of the EM algorithm to overcome the local maxima problem associated with the original EM algorithm. In our DA approach, the annealing process …

参考文章(22)
N. Ueda, R. Nakano, Mixture density estimation via EM algorithm with deterministic annealing ieee workshop on neural networks for signal processing. pp. 69- 77 ,(1994) , 10.1109/NNSP.1994.366062
Donald F. Specht, Probabilistic neural networks Neural Networks. ,vol. 3, pp. 109- 118 ,(1990) , 10.1016/0893-6080(90)90049-Q
Geoffrey J. McLachlan, Kaye E. Basford, Mixture models : inference and applications to clustering Statistics: Textbooks and Monographs. ,vol. 84, ,(1988)
G. Hinton, P Dayan, B. Frey, R. Neal, The "Wake-Sleep" Algorithm for Unsupervised Neural Networks Science. ,vol. 268, pp. 1158- 1161 ,(1995) , 10.1126/SCIENCE.7761831
L. R. Rabiner, B. H. Juang, Hidden Markov models for speech recognition Technometrics. ,vol. 33, pp. 251- 272 ,(1991) , 10.2307/1268779
Stuart Geman, Donald Geman, Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. PAMI-6, pp. 721- 741 ,(1984) , 10.1109/TPAMI.1984.4767596
Michael I Jordan, Robert A Jacobs, None, Hierarchical mixtures of experts and the EM algorithm Neural Computation. ,vol. 6, pp. 181- 214 ,(1994) , 10.1162/NECO.1994.6.2.181
Joachim Buhmann, Hans Kühnel, Complexity optimized data clustering by competitive neural networks Neural Computation. ,vol. 5, pp. 75- 88 ,(1993) , 10.1162/NECO.1993.5.1.75
A. P. Dempster, N. M. Laird, D. B. Rubin, Maximum Likelihood from Incomplete Data Via theEMAlgorithm Journal of the Royal Statistical Society: Series B (Methodological). ,vol. 39, pp. 1- 22 ,(1977) , 10.1111/J.2517-6161.1977.TB01600.X
J. Rissanen, Paper: Modeling by shortest data description Automatica. ,vol. 14, pp. 465- 471 ,(1978) , 10.1016/0005-1098(78)90005-5