The uniform convergence of nearest neighbor regression function estimators and their application in optimization
作者： L. Devroye
关键词: Statistics 、 Nonparametric regression 、 Mathematics 、 Uniform convergence 、 Applied mathematics 、 k-nearest neighbors algorithm 、 Function (mathematics) 、 Estimator 、 Noise 、 Search algorithm 、 Simple random sample
摘要: A class of nonparametric regression function estimates generalizing the nearest neighbor estimate Cover [ 12] is presented. Under various noise conditions, it shown that are strongly uniformly consistent. The uniform convergence can be exploited to design a simple random search algorithm for global minimization function.
devroye.org 参考文章(18)
Larry D. Cockrell, King Sun Fu, ON SEARCH TECHNIQUES IN ADAPTIVE SYSTEMS ,(1970)
Terry J. Wagner, On the Rate of Convergence for the Law of Large Numbers Annals of Mathematical Statistics. ,vol. 40, pp. 2195- 2197 ,(1969) , 10.1214/AOMS/1177697298
E. A. Nadaraya, On Estimating Regression Theory of Probability and Its Applications. ,vol. 9, pp. 141- 142 ,(1964) , 10.1137/1109020
Murray Rosenblatt, Remarks on Some Nonparametric Estimates of a Density Function Annals of Mathematical Statistics. ,vol. 27, pp. 832- 837 ,(1956) , 10.1214/AOMS/1177728190
D. Kh. Fuk, S. V. Nagaev, Probability Inequalities for Sums of Independent Random Variables Theory of Probability & Its Applications. ,vol. 16, pp. 643- 660 ,(1971) , 10.1137/1116071
É A. Nadaraya, Remarks on Non-Parametric Estimates for Density Functions and Regression Curves Theory of Probability & Its Applications. ,vol. 15, pp. 134- 137 ,(1970) , 10.1137/1115015
V. N. Vapnik, A. Ya. Chervonenkis, On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities Measures of Complexity. ,vol. 16, pp. 11- 30 ,(2015) , 10.1007/978-3-319-21852-6_3
T. Cover, Estimation by the nearest neighbor rule IEEE Transactions on Information Theory. ,vol. 14, pp. 50- 55 ,(1968) , 10.1109/TIT.1968.1054098
D. O. Loftsgaarden, C. P. Quesenberry, A nonparametric estimate of a multivariate density function Annals of Mathematical Statistics. ,vol. 36, pp. 1049- 1051 ,(1965) , 10.1214/AOMS/1177700079
Samuel H. Brooks, A Discussion of Random Methods for Seeking Maxima Operations Research. ,vol. 6, pp. 244- 251 ,(1958) , 10.1287/OPRE.6.2.244