Nonlinear Blind Source Separation by Variational Bayesian Learning

作者: Harri Valpola , Erkki Oja , Alexander Ilin , Aritti Honkela , Juha Karhunen

DOI:

关键词:

摘要: Blind separation of sources from their linear mixtures is a well understood problem. However, if the are nonlinear, this problem becomes generally very difficult. This because both nonlinear mapping and underlying must be learned data in blind manner, highly ill-posed without suitable regularization. In our approach, multilayer perceptrons used as generative models for data, variational Bayesian (ensemble) learning applied finding sources. The technique automatically provides reasonable regularization paper, we first consider static mixing model, with successful application to real-world speech compression. Then discuss extraction dynamic processes, detection abrupt changes process dynamics. difficult test chaotic approach clearly outperforms currently available prediction change techniques. proposed methods computationally demanding, but they can problems higher dimensions than other existing approaches.

参考文章(21)
H. Attias, ICA, graphical models and variational methods Independent Component Analysis. pp. 95- 112 ,(2001) , 10.1017/CBO9780511624148.004
Harri Valpola, Erkki Oja, Alexandre Iline, DETECTING PROCESS STATE CHANGES BY NONLINEAR BLIND SOURCE SEPARATION ,(2003)
J. W. Miskin, D.J.C. MacKay, Ensemble Learning for blind source separation Independent Component Analysis. pp. 209- 233 ,(2001) , 10.1017/CBO9780511624148.009
Pedro Højen-Sørensen, Ole Winther, Lars Kai Hansen, MEAN FIELD IMPLEMENTATION OF BAYESIAN ICA ,(2001)
Erkki Oja, Aapo Hyvarinen, Juha Karhunen, Independent Component Analysis ,(2001)
Aapo Hyvärinen, Petteri Pajunen, Nonlinear independent component analysis: existence and uniqueness results Neural Networks. ,vol. 12, pp. 429- 439 ,(1999) , 10.1016/S0893-6080(98)00140-3
Douglas C Montgomery, Phillip J Klatt, None, Economic Design ofT2Control Charts to Maintain Current Control of a Process Management Science. ,vol. 19, pp. 76- 89 ,(1972) , 10.1287/MNSC.19.1.76
Geoffrey E. Hinton, Drew van Camp, Keeping the neural networks simple by minimizing the description length of the weights conference on learning theory. pp. 5- 13 ,(1993) , 10.1145/168304.168306
Martin Casdagli, Nonlinear prediction of chaotic time series Physica D: Nonlinear Phenomena. ,vol. 35, pp. 335- 356 ,(1989) , 10.1016/0167-2789(89)90074-2