Jensen divergence based on Fisher's information

作者: J. S. Dehesa , P. Sánchez-Moreno , A. Zarzo , A. Zarzo

DOI: 10.1088/1751-8113/45/12/125305

关键词: Rényi entropyKullback–Leibler divergenceProbability distributionTotal correlationMathematicsJensen–Shannon divergenceFisher informationDifferential entropyMathematical analysisDivergence (statistics)

摘要: The measure of Jensen-Fisher divergence between probability distributions is introduced and its theoretical grounds set up. This quantity, in contrast to the remaining Jensen divergences, very sensitive fluctuations because it controlled by (local) Fisher information, which a gradient functional distribution. So, appropriate informative when studying similarity distributions, mainly for those having oscillatory character. new shares with Jensen-Shannon following properties: non-negativity, additivity applied an arbitrary number densities, symmetry under exchange these vanishing if only all densities are equal, definiteness even present non-common zeros. Moreover, shown be expressed terms relative information as does Kullback-Leibler or Shannon entropy. Finally divergences compared three large, non-trivial qualitatively different families distributions: sinusoidal, generalized gamma-like Rakhmanov-Hermite distributions.

参考文章(42)
Shunlong Luo, Quantum Fisher Information and Uncertainty Relations Letters in Mathematical Physics. ,vol. 53, pp. 243- 251 ,(2000) , 10.1023/A:1011080128419
Arnold F. Nikiforov, Vasilii B. Uvarov, Special Functions of Mathematical Physics Birkhäuser Boston. ,(1988) , 10.1007/978-1-4757-1595-8
H. Heyer, Information and Sufficiency Springer, New York, NY. pp. 142- 173 ,(1982) , 10.1007/978-1-4613-8218-8_7
Pedro W. Lamberti, Ana P. Majtey, Marcos Madrid, María E. Pereyra, Jensen‐Shannon Divergence: A Multipurpose Distance for Statistical and Quantum Mechanics NONEQUILIBRIUM STATISTICAL MECHANICS AND NONLINEAR PHYSICS: XV Conference on Nonequilibrium Statistical Mechanics and Nonlinear Physics. ,vol. 913, pp. 32- 37 ,(2007) , 10.1063/1.2746720
Damián H. Zanette, Segmentation and Context of Literary and Musical Sequences Complex Systems. ,vol. 17, ,(2007)
C. R. Rao, Chapter 5: Differential Metrics in Probability Spaces Institute of Mathematical Statistics. pp. 217- 240 ,(1987) , 10.1214/LNMS/1215467062
Fei Wang, Tanveer Syeda-Mahmood, Baba C. Vemuri, David Beymer, Anand Rangarajan, Closed-Form Jensen-Renyi Divergence for Mixture of Gaussians and Applications to Group-Wise Shape Registration Medical Image Computing and Computer-Assisted Intervention – MICCAI 2009. ,vol. 12, pp. 648- 655 ,(2009) , 10.1007/978-3-642-04268-3_80
Pedro W. Lamberti, Ana P. Majtey, Non-logarithmic Jensen-Shannon divergence Physica A-statistical Mechanics and Its Applications. ,vol. 329, pp. 81- 90 ,(2003) , 10.1016/S0378-4371(03)00566-1
S. Kullback, R. A. Leibler, On Information and Sufficiency Annals of Mathematical Statistics. ,vol. 22, pp. 79- 86 ,(1951) , 10.1214/AOMS/1177729694