Reproducing kernel space embeddings and metrics on probability measures

作者: Gert R. Lanckriet , Bharath Kumar Sriperumbudur Vangeepuram

DOI:

关键词: EmbeddingPseudometric spaceProbability measureDiscrete mathematicsHilbert spaceMetric (mathematics)Reproducing kernel Hilbert spaceMathematicsBanach spaceKernel (statistics)

摘要: The notion of Hilbert space embedding probability measures has recently been used in various statistical applications like dimensionality reduction, homogeneity testing, independence etc. This represents any measure as a mean element reproducing kernel (RKHS). A pseudometric on the can be defined distance between distribution embeddings: we denote this γ k, indexed by positive definite (pd) function k that defines inner product RKHS. In dissertation, theoretical properties and associated RKHS are presented. First, order for to useful practice, it is essential metric not just pseudometric. Therefore, easily checkable characterizations have obtained so γk (such referred characteristic kernels), contrast previously published which either difficult check or may apply only restricted circumstances (e.g., compact domains). Second, relation kernels richness RKHS--how well an approximates some target space--and other common notions pd strictly (spd), integrally spd, conditionally etc., studied. Third, question nature topology induced studied wherein shown with spd kernels--a stronger than kernel--metrize weak* (weak-star) measures. Fourth, compared integral metrics (IPMs) p-divergences, empirical estimator simple compute exhibits fast rate convergence those IPMs p-divergences. These make more applicable practice these families distances. Finally, novel into Banach (RKBS) proposed its It generalize their counterparts, thereby resulting richer probabilities.

参考文章(89)
Colin Campbell, Yiming Ying, Generalization bounds for learning the kernel ,(2009)
Peter L. Bartlett, Shahar Mendelson, Rademacher and gaussian complexities: risk bounds and structural results european conference on computational learning theory. ,vol. 3, pp. 463- 482 ,(2003) , 10.1007/3-540-44581-1_15
Wolfgang Dahmen, C. A. Micchelli, Some remarks on ridge functions Approximation Theory and Its Applications. ,vol. 3, pp. 139- 143 ,(1987)
Charles A. Micchelli, Yuesheng Xu, Haizhang Zhang, Universal Kernels The Journal of Machine Learning Research archive. ,vol. 7, pp. 2651- 2667 ,(2006)
C. CARMELI, E. DE VITO, A. TOIGO, V. UMANITÀ, VECTOR VALUED REPRODUCING KERNEL HILBERT SPACES AND UNIVERSALITY Analysis and Applications. ,vol. 08, pp. 19- 61 ,(2010) , 10.1142/S0219530510001503
Colin McDiarmid, Surveys in Combinatorics, 1989: On the method of bounded differences Cambridge University Press. pp. 148- 188 ,(1989) , 10.1017/CBO9781107359949.008
C. C. Taylor, Luc Devroye, Laszlo Gyorfi, Nonparametric Density Estimation: The L1 View Journal of the Royal Statistical Society: Series A (General). ,vol. 148, pp. 392- 393 ,(1985) , 10.2307/2981908
Walter Rudin, Functional Analysis ,(1973)