On the Noise Model of Support Vector Machines Regression

作者: Massimiliano Pontil , Sayan Mukherjee , Federico Girosi

DOI: 10.1007/3-540-40992-0_24

关键词:

摘要: Support Vector Machines Regression (SVMR) is a learning technique where the goodness of fit measured not by usual quadratic loss function (the mean square error), but different called Ɛ-Insensitive Loss Function (ILF), which similar to functions used in field robust statistics. The well justified under assumption Gaussian additive noise. However, noise model underlying choice ILF clear. In this paper use that and Gaussian, variance are random variables. probability distributions for will be stated explicitly. While work presented framework SVMR, it can extended justify nonquadratic any Maximum Likelihood or AP osteriori approach. It applies only ILF, much broader class functions.

参考文章(11)
V. N. Vapnik, The Nature of Statistical Learning Theory. ,(1995)
Federico Girosi, Michael Jones, Tomaso Poggio, Regularization theory and neural networks architectures Neural Computation. ,vol. 7, pp. 219- 269 ,(1995) , 10.1162/NECO.1995.7.2.219
George S. Kimeldorf, Grace Wahba, A Correspondence Between Bayesian Estimation on Stochastic Processes and Smoothing by Splines Annals of Mathematical Statistics. ,vol. 41, pp. 495- 502 ,(1970) , 10.1214/AOMS/1177697089
Federico Girosi, MASSACHUSETTS INST OF TECH CAMBRIDGE ARTIFICIAL INTELLIGENCE LAB, Models of Noise and Robust Estimation Massachusetts Institute of Technology. ,(1991)
Theodoros Evgeniou, Massimiliano Pontil, Tomaso Poggio, Regularization Networks and Support Vector Machines Advances in Computational Mathematics. ,vol. 13, pp. 1- 50 ,(2000) , 10.1023/A:1018946025316
Alex J. Smola, Vladimir Vapnik, Steven E. Golowich, Support Vector Method for Function Approximation, Regression Estimation and Signal Processing neural information processing systems. ,vol. 9, pp. 281- 287 ,(1996)
Vladimir Naumovich Vapnik, Vlamimir Vapnik, Statistical learning theory John Wiley & Sons. ,(1998)
Tomaso Poggio, Federico Girosi, A sparse representation for function approximation Neural Computation. ,vol. 10, pp. 1445- 1454 ,(1998) , 10.1162/089976698300017250
Federico Girosi, An equivalence between sparse approximation and support vector machines Neural Computation. ,vol. 10, pp. 1455- 1480 ,(1998) , 10.1162/089976698300017269