Some Remarks on the Definition of Boltzmann, Shannon and Kolmogorov Entropy

作者: Vieri Benci , Giulia Menconi

DOI: 10.1007/S00032-005-0043-Z

关键词:

摘要: We give an alternative definition of Shannon and Kolmogorov-Sinai entropies based on the Boltzmann formula S = k log W. prove equivalence those new definitions with traditional ones using some tools from Information Theory such as information function empirical entropy.

参考文章(5)
Jon Louis Bentley, Andrew Chi-Chih Yao, An almost optimal algorithm for unbounded searching Information Processing Letters. ,vol. 5, pp. 82- 87 ,(1976) , 10.1016/0020-0190(76)90071-5
C Shanndn, W Weaver, The Mathematical Theory of Communication ,(1948)
Anatole Katok, AB Katok, Boris Hasselblatt, Introduction to the modern theory of dynamical systems ,(1995)
Aleksandr Yakovlevich Khinchin, Mathematical foundations of information theory ,(1957)
J. Ziv, A. Lempel, Compression of individual sequences via variable-rate coding IEEE Transactions on Information Theory. ,vol. 24, pp. 530- 536 ,(1978) , 10.1109/TIT.1978.1055934