Active Learning Using Arbitrary Binary Valued Queries

作者: S.R. Kulkarni , S.K. Mitter , J.N. Tsitsiklis

DOI: 10.1023/A:1022627018023

关键词:

摘要: The original and most widely studied PAC model for learning assumes a passive learner in the sense that plays no role obtaining information about unknown concept. That is, samples are simply drawn independently from some probability distribution. Some work has been done on studying more powerful oracles how they affect learnability. To find bounds improvement sample complexity can be expected using oracles, we consider active complete control over received. Specifically, allow to ask arbitrary yes/no questions. We both under fixed distribution distribution-free learning. In case of learning, underlying is used only measure distance between concepts. For learnability with respect distribution, does not enlarge set learnable concept classes, but improve complexity. it shown class actively iff finite, so fact less than usual model. also form which knows being used, “distribution-free” refers requirement bound number queries obtained uniformly all distributions. Even side finite VC dimension, still classes.

参考文章(22)
JONATHAN AMSTERDAM, Extending the Valiant Learning Model international conference on machine learning. pp. 381- 394 ,(1988) , 10.1016/B978-0-934613-64-4.50044-X
Sanjoy K. Mitter, Sanjeev Ramesh Kulkarni, Problems of computational and information complexity in machine vision and learning Massachusetts Institute of Technology. ,(1991)
Ronald L. Rivest, Bonnie Eisenberg, On the sample complexity of pac-learning using random and chosen examples conference on learning theory. pp. 154- 162 ,(1990) , 10.5555/92571.92623
Alon Itai, Gyora M. Benedek, Learnability by fixed distributions conference on learning theory. pp. 80- 90 ,(1988) , 10.5555/93025.93057
L. G. Valiant, A theory of the learnable symposium on the theory of computing. ,vol. 27, pp. 1134- 1142 ,(1984) , 10.1145/800057.808710
V. N. Vapnik, A. Ya. Chervonenkis, On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities Measures of Complexity. ,vol. 16, pp. 11- 30 ,(2015) , 10.1007/978-3-319-21852-6_3
R. M. Dudley, Central Limit Theorems for Empirical Measures Annals of Probability. ,vol. 6, pp. 899- 929 ,(1978) , 10.1214/AOP/1176995384
B. K. Natarajan, Probably approximate learning over classes of distributions SIAM Journal on Computing. ,vol. 21, pp. 438- 449 ,(1992) , 10.1137/0221029