A greedy screening test strategy to accelerate solving LASSO problems with small regularization parameters

作者: Hai-Wei Shen , Hua Chai , Liang-Yong Xia , Sheng-Bing Wu , Wei Qu

DOI: 10.1007/S00500-019-04275-X

关键词:

摘要: In the era of big data remarked by high dimensionality and large sample size, least absolute shrinkage selection operator (LASSO) problems demand efficient algorithms. Both static dynamic strategies based on screening test principle have been proposed recently, in order to safely filter out irrelevant atoms from dictionary. However, such only work well for LASSO with regularization parameters, lose their efficiency those small parameters. This paper presents a novel greedy strategy accelerate solving as its effectiveness through adoption relatively larger parameter which filters every iteration. Further more, convergence proof is given, computational complexity solvers integrated this investigated. Numerical experiments both synthetic real sets support strategy, results show it outperforms

参考文章(34)
Léon Bottou, Large-Scale Machine Learning with Stochastic Gradient Descent Proceedings of COMPSTAT'2010. pp. 177- 186 ,(2010) , 10.1007/978-3-7908-2604-3_16
Zhen James Xiang, Yun Wang, Peter J. Ramadge, Screening Tests for Lasso Problems IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 39, pp. 1008- 1027 ,(2017) , 10.1109/TPAMI.2016.2568185
Vivek Agarwal, Andrei V. Gribok, Mongi A. Abidi, Image restoration using L1 norm penalty function Inverse Problems in Science and Engineering. ,vol. 15, pp. 785- 809 ,(2007) , 10.1080/17415970600971987
Shai Shalev-Shwartz, Ambuj Tewari, Stochastic methods forl1regularized loss minimization Proceedings of the 26th Annual International Conference on Machine Learning - ICML '09. pp. 929- 936 ,(2009) , 10.1145/1553374.1553493
Wei Li, Jianxing Feng, Tao Jiang, IsoLasso: a LASSO regression approach to RNA-Seq based transcriptome assembly. Journal of Computational Biology. ,vol. 18, pp. 1693- 1707 ,(2011) , 10.1089/CMB.2011.0171
D. Angelosante, G. B. Giannakis, E. Grossi, Compressed sensing of time-varying signals international conference on digital signal processing. pp. 816- 823 ,(2009) , 10.1109/ICDSP.2009.5201168
J.M. Bioucas-Dias, M.A.T. Figueiredo, A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration IEEE Transactions on Image Processing. ,vol. 16, pp. 2992- 3004 ,(2007) , 10.1109/TIP.2007.909319
Yu. Nesterov, Gradient methods for minimizing composite functions Mathematical Programming. ,vol. 140, pp. 125- 161 ,(2013) , 10.1007/S10107-012-0629-5
Robert Tibshirani, Trevor Hastie, Berwin A. Turlach, Bradley Efron, Jean Michel Loubes, Jean Michel Loubes, Hemant Ishwaran, Robert A. Stine, Keith Knight, Sanford Weisberg, Saharon Rosset, Saharon Rosset, Iain Johnstone, Pascal Massart, Pascal Massart, David Madigan, J. I. Zhu, Greg Ridgeway, Greg Ridgeway, Least angle regression Annals of Statistics. ,vol. 32, pp. 407- 499 ,(2004) , 10.1214/009053604000000067
Antonin Chambolle, Thomas Pock, A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging Journal of Mathematical Imaging and Vision. ,vol. 40, pp. 120- 145 ,(2011) , 10.1007/S10851-010-0251-1