/spl epsi/-SSVR: a smooth support vector machine for /spl epsi/-insensitive regression

作者: Yuh-Jye Lee , Wen-Feng Hsieh , Chien-Ming Huang

DOI: 10.1109/TKDE.2005.77

关键词: Least squares support vector machineSupport vector machineMathematicsKernel (linear algebra)AlgorithmConvex optimizationQuadratic programmingSmoothingKernel methodComputational complexity theory

摘要: A new smoothing strategy for solving /spl epsi/-support vector regression (/spl epsi/-SVR), tolerating a small error in fitting given data set linearly or nonlinearly, is proposed this paper. Conventionally, epsi/-SVR formulated as constrained minimization problem, namely, convex quadratic programming problem. We apply the techniques that have been used support machine classification, to replace epsi/-insensitive loss function by an accurate smooth approximation. This will allow us solve unconstrained problem directly. term reformulated epsi/-smooth epsi/-SSVR). also prescribe Newton-Armijo algorithm has shown be convergent globally and quadratically our epsi/-SSVR. In order handle case of nonlinear with massive set, we introduce reduced kernel technique paper avoid computational difficulties dealing huge fully dense matrix. Numerical results comparisons are demonstrate effectiveness speed algorithm.

参考文章(32)
Yinyu Ye, Xiaojun Chen, On Homotopy-Smoothing Methods for Variational Inequalities Siam Journal on Control and Optimization. ,(1999)
O.L. Mangasarian, David R. Musicant, Large Scale Kernel Regression via Linear Programming Machine Learning. ,vol. 46, pp. 255- 269 ,(2002) , 10.1023/A:1012422931930
Olvi Mangasarian, Generalized Support Vector Machines ,(1998)
Nello Cristianini, J Shawe-Taylor, An introduction to Support Vector Machines Cambridge University Press (2000). ,(2000)
Peter W. Christensen, Jong-Shi Pang, Frictional Contact Algorithms Based on Semismooth Newton Methods Springer, Boston, MA. pp. 81- 116 ,(1998) , 10.1007/978-1-4757-6388-1_5
Olvi L. Mangasarian, Yuh-Jye Lee, RSVM: Reduced Support Vector Machines siam international conference on data mining. pp. 1- 17 ,(2001)
J. E. Dennis, Robert B. Schnabel, Numerical Methods for Unconstrained Optimization and Nonlinear Equations (Classics in Applied Mathematics, 16) Numerical Methods for Unconstrained Optimization and Nonlinear Equations (Classics in Applied Mathematics, 16). ,(1996)
R. Clint Whaley, Antoine Petitet, Jack J. Dongarra, New trends in high performance computing ieee international conference on high performance computing data and analytics. ,vol. 27, pp. 3- 35 ,(2001) , 10.1016/S0167-8191(00)00087-9