Rate Optimal Denoising of Simultaneously Sparse and Low Rank Matrices

作者: Zongming Ma , Andreas Buja , Dan Yang

DOI:

关键词: Iterative thresholdingRank (linear algebra)MathematicsNoise reductionMinimaxLarge classAlgorithm

摘要: We study minimax rates for denoising simultaneously sparse and low rank matrices in high dimensions. show that an iterative thresholding algorithm achieves (near) optimal adaptively under mild conditions a large class of loss functions. Numerical experiments on synthetic datasets also demonstrate the competitive performance proposed method.

参考文章(28)
Zongming Ma, Andreas Buja, Dan Yang, A Sparse SVD Method for High-dimensional Data arXiv: Methodology. ,(2011)
Karim Lounici, Massimiliano Pontil, Sara van de Geer, Alexandre B. Tsybakov, Oracle Inequalities and Optimal Inference under Group Sparsity Annals of Statistics. ,vol. 39, pp. 2164- 2204 ,(2011) , 10.1214/11-AOS896
Mihee Lee, Haipeng Shen, Jianhua Z. Huang, J. S. Marron, Biclustering via Sparse Singular Value Decomposition Biometrics. ,vol. 66, pp. 1087- 1095 ,(2010) , 10.1111/J.1541-0420.2010.01392.X
Vladislav Voroninski, Xiaodong Li, Sparse Signal Recovery from Quadratic Measurements via Convex Programming arXiv: Information Theory. ,(2012)
G. Chen, P. F. Sullivan, M. R. Kosorok, Biclustering with heterogeneous variance Proceedings of the National Academy of Sciences of the United States of America. ,vol. 110, pp. 12253- 12258 ,(2013) , 10.1073/PNAS.1304376110
Per-Åke Wedin, Perturbation bounds in connection with singular value decomposition Bit Numerical Mathematics. ,vol. 12, pp. 99- 111 ,(1972) , 10.1007/BF01932678
Emmanuel J Candes, Yaniv Plan, Matrix Completion With Noise Proceedings of the IEEE. ,vol. 98, pp. 925- 936 ,(2010) , 10.1109/JPROC.2009.2035722
Jianqing Fan, Runze Li, Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties Journal of the American Statistical Association. ,vol. 96, pp. 1348- 1360 ,(2001) , 10.1198/016214501753382273
Andreas Buja, Zongming Ma, Dan Yang, Optimal denoising of simultaneously sparse and low rank matrices in high dimensions allerton conference on communication, control, and computing. pp. 445- 447 ,(2013) , 10.1109/ALLERTON.2013.6736558
Samet Oymak, Amin Jalali, Maryam Fazel, Yonina C. Eldar, Babak Hassibi, Simultaneously Structured Models With Application to Sparse and Low-Rank Matrices IEEE Transactions on Information Theory. ,vol. 61, pp. 2886- 2908 ,(2015) , 10.1109/TIT.2015.2401574