Expectation maximization hard thresholding methods for sparse signal reconstruction

作者: Kun Qiu

DOI: 10.31274/ETD-180810-1448

关键词: Signal reconstructionSignal processingExpectation–maximization algorithmLikelihood functionOrdered subset expectation maximizationMaximizationUnderdetermined systemPattern recognitionMathematicsArtificial intelligenceThresholding

摘要: Reconstructing a high dimensional sparse signal from low linear measurements has been an important problem in various research disciplines including statistics, machining learning, data mining and processing. In this dissertation, we develop probabilistic framework for reconstruction propose several novel algorithms computing the maximum likelihood (ML) estimates under framework. We first consider underdetermined model where regression-coefficient vector is sum of unknown deterministic component zero-mean white Gaussian with variance. Our schemes are based on expectation-conditional maximization either (ECME) iteration that aims at maximizing function respect to parameters given sparsity level. double overrelaxation (DORE) thresholding scheme accelerating ECME prove that, certain conditions, DORE iterations converge local maxima achieve near-optimal or perfect recovery approximately signals, respectively. If level unknown, introduce unconstrained selection (USS) criterion tuning-free automatic (ADORE) method employs USS estimate applications such as tomographic imaging, interest nonnegative. modify our algorithm incorporate additional nonnegativity constraint. The step modified approximated by difference map iteration. compare proposed existing methods using simulated real-data imaging experiments. Finally, generalized expectation-maximization (GEM)

参考文章(75)
Gabriel Peyré, S. G. Mallat, A Wavelet Tour of Signal Processing : The Sparse Way Elsevier/Academic Press. ,(2008)
L.L. Scharf, S. Kraut, M.L. McCloud, A review of matched and adaptive subspace detectors Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373). pp. 82- 86 ,(2000) , 10.1109/ASSPCC.2000.882451
Chris Holmes, Arnaud Doucet, Anthony Lee, Francois Caron, A Hierarchical Bayesian Framework for Constructing Sparsity-inducing Priors arXiv: Methodology. ,(2010)
Rahul Mazumder, Jerome H. Friedman, Trevor Hastie, SparseNet: Coordinate Descent With Nonconvex Penalties. Journal of the American Statistical Association. ,vol. 106, pp. 1125- 1138 ,(2011) , 10.1198/JASA.2011.TM09738
Sailes K. Sengijpta, Fundamentals of Statistical Signal Processing: Estimation Theory Technometrics. ,vol. 37, pp. 465- 466 ,(1995) , 10.1080/00401706.1995.10484391
Alfred M. Bruckstein, David L. Donoho, Michael Elad, From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images Siam Review. ,vol. 51, pp. 34- 81 ,(2009) , 10.1137/060657704
Volkan Cevher, Piotr Indyk, Lawrence Carin, Richard Baraniuk, Sparse Signal Recovery and Acquisition with Graphical Models IEEE Signal Processing Magazine. ,vol. 27, pp. 92- 103 ,(2010) , 10.1109/MSP.2010.938029
Thomas Blumensath, Mike E. Davies, Iterative thresholding for sparse approximations Journal of Fourier Analysis and Applications. ,vol. 14, pp. 629- 654 ,(2008) , 10.1007/S00041-008-9035-Z