Bayesian learning for sparse signal reconstruction

作者: D.P. Wipf , B.D. Rao

DOI: 10.1109/ICASSP.2003.1201753

关键词:

摘要: Sparse Bayesian learning and specifically relevance vector machines have received much attention as a means of achieving parsimonious representations signals in the context regression classification. We provide simplified derivation this paradigm from evidence perspective apply it to problem basis selection overcomplete dictionaries. Furthermore, we prove that stable fixed points resulting algorithm are necessarily sparse, providing solid theoretical justification for adapting methodology tasks. then include simulation studies comparing sparse with pursuit more recent FOCUSS class algorithms, empirically demonstrating superior performance terms average sparsity success rate recovering generative bases.

参考文章(8)
Michael E Tipping, Sparse bayesian learning and the relevance vector machine Journal of Machine Learning Research. ,vol. 1, pp. 211- 244 ,(2001) , 10.1162/15324430152748236
Scott Shaobing Chen, David L. Donoho, Michael A. Saunders, Atomic Decomposition by Basis Pursuit SIAM Journal on Scientific Computing. ,vol. 20, pp. 33- 61 ,(1998) , 10.1137/S1064827596304010
I.F. Gorodnitsky, B.D. Rao, Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm IEEE Transactions on Signal Processing. ,vol. 45, pp. 600- 616 ,(1997) , 10.1109/78.558475
B.D. Rao, K. Kreutz-Delgado, An affine scaling methodology for best basis selection IEEE Transactions on Signal Processing. ,vol. 47, pp. 187- 200 ,(1999) , 10.1109/78.738251
B.D. Rao, Signal processing with the sparseness constraint international conference on acoustics speech and signal processing. ,vol. 3, pp. 1861- 1864 ,(1998) , 10.1109/ICASSP.1998.681826
B.D. Rao, K. Engan, S.F. Cotter, J. Palmer, K. Kreutz-Delgado, Subset selection in noise based on diversity measure minimization IEEE Transactions on Signal Processing. ,vol. 51, pp. 760- 770 ,(2003) , 10.1109/TSP.2002.808076
Charles R. Johnson, Roger A. Horn, Matrix Analysis ,(1985)
David J. C. MacKay, Bayesian interpolation Neural Computation archive. ,vol. 4, pp. 415- 447 ,(1992) , 10.1162/NECO.1992.4.3.415