On the mutual nearest neighbors estimate in regression

作者: Arnaud Guyader , Nick Hengartner

DOI:

关键词: EstimatorRegressionMathematical statisticsStatisticsDistribution (mathematics)MathematicsSample (statistics)k-nearest neighbors algorithmNearest-neighbor chain algorithmRate of convergenceApplied mathematics

摘要: Motivated by promising experimental results, this paper investigates the theoretical properties of a recently proposed nonparametric estimator, called Mutual Nearest Neighbors rule, which estimates regression function m(x) = E[Y|X x] as follows: first identify k nearest neighbors x in sample Dn, then keep only those for is itself one neighbors, and finally take average over corresponding response variables. We prove that estimator consistent its rate convergence optimal. Since estimate with optimal depends on unknown distribution observations, we also present adaptation results data-splitting.

参考文章(22)
László Györfi, Michael Kohler, Adam Krzyżak, Harro Walk, A distribution-free theory of nonparametric regression Published in <b>2002</b> in New York NY) by Springer. ,(2002) , 10.1007/B97848
R. Z. Khasʹminskiĭ, I. A. Ibragimov, Statistical estimation : asymptotic theory Springer-Verlag. ,(1981)
László Györfi, Luc Devroye, Gábor Lugosi, A Probabilistic Theory of Pattern Recognition ,(1996)
Paolo Tilli, Luigi Ambrosio, Topics on analysis in metric spaces ,(2004)
Elia Liitiäinen, Francesco Corona, Amaury Lendasse, Residual variance estimation using a nearest neighbor statistic Journal of Multivariate Analysis. ,vol. 101, pp. 811- 823 ,(2010) , 10.1016/J.JMVA.2009.12.020
K. Chidananda Gowda, G. Krishna, Agglomerative clustering using the concept of mutual nearest neighbourhood Pattern Recognition. ,vol. 10, pp. 105- 112 ,(1978) , 10.1016/0031-3203(78)90018-3
Frédéric Cérou, Arnaud Guyader, Nearest neighbor classification in infinite dimension Esaim: Probability and Statistics. ,vol. 10, pp. 340- 355 ,(2006) , 10.1051/PS:2006014