A variable metric mini-batch proximal stochastic recursive gradient algorithm with diagonal Barzilai-Borwein stepsize.
作者： Yu-Hong Dai , Xinwei Liu , Tengteng Yu , Jie Sun
DOI:
关键词:
摘要: … Abstract—Variable metric proximal gradient methods with different metric … the Barzilai-Borwein (BB) method with a diagonal selection strategy for the metric, the diagonal BB stepsize …
arxiv.org
harvard.edu参考文章(40)
Shai Shalev-Shwartz, Shai Ben-David, Understanding Machine Learning: From Theory to Algorithms ,(2015)
Roger Fletcher, On the Barzilai-Borwein Method Springer, Boston, MA. pp. 235- 256 ,(2005) , 10.1007/0-387-24255-4_10
James Franklin, The elements of statistical learning : data mining, inference,and prediction The Mathematical Intelligencer. ,vol. 27, pp. 83- 85 ,(2005) , 10.1007/BF02985802
Sebastian Nowozin, Stephen J. Wright, Suvrit Sra, Optimization for Machine Learning neural information processing systems. pp. 72- 73 ,(2011)
Herbert Robbins, Sutton Monro, A Stochastic Approximation Method Annals of Mathematical Statistics. ,vol. 22, pp. 400- 407 ,(1951) , 10.1214/AOMS/1177729586
Guanghui Lan, An optimal method for stochastic composite optimization Mathematical Programming. ,vol. 133, pp. 365- 397 ,(2012) , 10.1007/S10107-010-0434-Y
Yu. Nesterov, Gradient methods for minimizing composite functions Mathematical Programming. ,vol. 140, pp. 125- 161 ,(2013) , 10.1007/S10107-012-0629-5
Lin Xiao, Tong Zhang, A PROXIMAL STOCHASTIC GRADIENT METHOD WITH PROGRESSIVE VARIANCE REDUCTION Siam Journal on Optimization. ,vol. 24, pp. 2057- 2075 ,(2014) , 10.1137/140961791
J. F. Bonnans, J. Ch. Gilbert, C. Lemaréchal, C. A. Sagastizábal, A family of variable metric proximal methods Mathematical Programming. ,vol. 68, pp. 15- 47 ,(1995) , 10.1007/BF01585756
JONATHAN BARZILAI, JONATHAN M. BORWEIN, Two-Point Step Size Gradient Methods Ima Journal of Numerical Analysis. ,vol. 8, pp. 141- 148 ,(1988) , 10.1093/IMANUM/8.1.141