Density-Difference Estimation

作者: Masashi Sugiyama , Takafumi Kanamori , Taiji Suzuki , Marthinus Christoffel du Plessis , Song Liu

DOI: 10.1162/NECO_A_00492

关键词:

摘要: We address the problem of estimating difference between two probability densities. A naive approach is a two-step procedure first densities separately and then computing their difference. However, this does not necessarily work well because step performed without regard to second step, thus small estimation error incurred in stage can cause big stage. In letter, we propose single-shot for directly density derive nonparametric finite-sample bound proposed density-difference estimator show that it achieves optimal convergence rate. how be used L2-distance approximation. Finally, experimentally demonstrate usefulness method robust distribution comparison such as class-prior change-point detection.

参考文章(75)
Taiji Suzuki, Masashi Sugiyama, Takafumi Kanamori, Density Ratio Estimation in Machine Learning ,(2012)
Joaquin Quiñonero-Candela, Masashi Sugiyama, Anton Schwaighofer, Neil D Lawrence, Covariate Shift by Kernel Mean Matching neural information processing systems. pp. 131- 160 ,(2009) , 10.7551/MITPRESS/9780262170055.003.0008
Matthias Krauledat, Klaus-Robert Müller, Masashi Sugiyama, Covariate Shift Adaptation by Importance Weighted Cross Validation Journal of Machine Learning Research. ,vol. 8, pp. 985- 1005 ,(2007)
Masao Yamanaka, Masakazu Matsugu, Masashi Sugiyama, Salient Object Detection Based on Direct Density-ratio Estimation Ipsj Online Transactions. ,vol. 6, pp. 96- 103 ,(2013) , 10.2197/IPSJTRANS.6.96
Wolfgang Härdle, Axel Werwatz, Marlene Müller, Stefan Sperlich, Nonparametric and Semiparametric Models ,(2004)
Semi-Supervised Learning Advanced Methods in Sequence Analysis Lectures. pp. 221- 232 ,(2010) , 10.7551/MITPRESS/9780262033589.001.0001
David G. Stork, Richard O. Duda, Peter E. Hart, Pattern Classification (2nd ed.) ,(1999)
Zaid Harchaoui, Sylvain Arlot, Alain Celisse, Kernel change-point detection arXiv: Statistics Theory. ,(2012)
James Franklin, The elements of statistical learning : data mining, inference,and prediction The Mathematical Intelligencer. ,vol. 27, pp. 83- 85 ,(2005) , 10.1007/BF02985802