Analysis of Perceptron-Based Active Learning

作者: Sanjoy Dasgupta , Adam Tauman Kalai , Claire Monteleoni

DOI: 10.1007/11503415_17

关键词:

摘要: We start by showing that in an active learning setting, the Perceptron algorithm needs Ω(1/e2) labels to learn linear separators within generalization error e. then present a simple for this problem, which combines modification of update with adaptive filtering rule deciding points query. For data distributed uniformly over unit sphere, we show our reaches e after asking just O(d log 1/e) labels. This exponential improvement usual sample complexity supervised had previously been demonstrated only computationally more complex query-by-committee algorithm.

参考文章(29)
Matti Kääriäinen, Active learning in the non-realizable case algorithmic learning theory. pp. 63- 77 ,(2006) , 10.1007/11894841_9
Yoav Freund, H. Sebastian Seung, Eli Shamir, Naftali Tishby, Selective Sampling Using the Query by Committee Algorithm Machine Learning. ,vol. 28, pp. 133- 168 ,(1997) , 10.1023/A:1007330508534
Tommi S. Jaakkola, Claire E. Monteleoni, Learning with online constraints: shifting concepts and active learning Massachusetts Institute of Technology. ,(2006)
Nicolò Cesa-Bianchi, Alex Conconi, Claudio Gentile, Learning Probabilistic Linear-Threshold Classifiers via Selective Sampling Learning Theory and Kernel Machines. pp. 373- 387 ,(2003) , 10.1007/978-3-540-45167-9_28
Eric B. Baum, The Perceptron Algorithm Is Fast for Non-Malicious Distributions neural information processing systems. ,vol. 2, pp. 676- 685 ,(1989) , 10.1162/NECO.1990.2.2.248
Rocco A. Servedio, On PAC learning using Winnow, Perceptron, and a Perceptron-like algorithm Proceedings of the twelfth annual conference on Computational learning theory - COLT '99. pp. 296- 307 ,(1999) , 10.1145/307400.307474
H. S. Seung, M. Opper, H. Sompolinsky, Query by committee conference on learning theory. pp. 287- 294 ,(1992) , 10.1145/130385.130417
William A. Gale, David D. Lewis, A sequential algorithm for training text classifiers international acm sigir conference on research and development in information retrieval. pp. 3- 12 ,(1994) , 10.5555/188490.188495