Large margin classification using the perceptron algorithm

作者: Yoav Freund , Robert E. Schapire

DOI: 10.1145/279943.279985

关键词:

摘要: We introduce and analyze a new algorithm for linear classification which combines Rosenblatt‘s perceptron with Helmbold Warmuth‘s leave-one-out method. Like Vapnik‘s maximal-margin classifier, our takes advantage of data that are linearly separable large margins. Compared to algorithm, however, ours is much simpler implement, more efficient in terms computation time. also show can be efficiently used very high dimensional spaces using kernel functions. performed some experiments variants it, classifying images handwritten digits. The performance close to, but not as good as, the classifiers on same problem, while saving significantly time programming effort.

参考文章(22)
N Cristianini, T Friess, Icg Campbell, The Kernel-Adatron : A fast and simple learning procedure for support vector machines (Ed) Shavlik,J. ,(1998)
Nello Cristianini, Colin Campbell, Thilo-Thomas Frieß, The Kernel-Adatron Algorithm: A Fast and Simple Learning Procedure for Support Vector Machines international conference on machine learning. pp. 188- 196 ,(1998)
M. A. Aizerman, Theoretical Foundations of the Potential Function Method in Pattern Recognition Learning Automation and Remote Control. ,vol. 25, pp. 821- 837 ,(1964)
Vladimir Naumovich Vapnik, Estimation of Dependences Based on Empirical Data ,(2010)
Jude Shavlik, Machine Learning: Proceedings of the Fifteenth International Conference Defense Technical Information Center. ,(1998) , 10.21236/ADA350721
Leon Bottou, Leon Bottou, V. Vapnik, Yann Lecun, I. Guyon, Eduard Sackinger, Corinna Cortes, Corinna Cortes, U.A. Muller, Patrice Simard, Patrice Simard, A. Brunot, Harris Drucker, Harris Drucker, L.D. Jackel, J. S. Denker, J. S. Denker, Comparison of learning algorithms for handwritten digit recognition EC2 & Cie. pp. 53- 60 ,(1995)
D.P. Helmbold, M.K. Warmuth, On Weak Learning Journal of Computer and System Sciences. ,vol. 50, pp. 551- 573 ,(1995) , 10.1006/JCSS.1995.1044
Nicolò Cesa-Bianchi, Yoav Freund, David Haussler, David P. Helmbold, Robert E. Schapire, Manfred K. Warmuth, How to use expert advice Journal of the ACM. ,vol. 44, pp. 427- 485 ,(1997) , 10.1145/258128.258179
Jyrki Kivinen, Manfred K. Warmuth, Additive versus exponentiated gradient updates for linear prediction symposium on the theory of computing. pp. 209- 218 ,(1995) , 10.1145/225058.225121
Nick Littlestone, From on-line to batch learning conference on learning theory. pp. 269- 284 ,(1989) , 10.5555/93335.93365