Maximum Entropy Rate Reconstruction of Markov Dynamics

作者: Gregor Chliamovitch , Alexandre Dupuis , Bastien Chopard

DOI: 10.3390/E17063738

关键词: Principle of maximum entropyMaximum-entropy Markov modelMaximum entropy thermodynamicsMathematical optimizationMaximum entropy spectral estimationMaximum entropy probability distributionMarkov chainRényi entropyMathematicsStatistical physicsEntropy rate

摘要: We develop ideas proposed by Van der Straeten to extend maximum entropy principles Markov chains. focus in particular on the convergence of such estimates order explain how our approach makes possible estimation transition probabilities when only short samples are available, which opens way applications non-stationary processes. The current work complements an earlier communication providing numerical details, as well a full derivation multi-constraint two-state and three-state matrices.

参考文章(21)
Greg J. Stephens, William Bialek, Statistical mechanics of letters in words. Physical Review E. ,vol. 81, pp. 066119- 066119 ,(2010) , 10.1103/PHYSREVE.81.066119
Greg J. Stephens, Thierry Mora, Gašper Tkačik, William Bialek, Statistical thermodynamics of natural images. Physical Review Letters. ,vol. 110, pp. 018701- ,(2013) , 10.1103/PHYSREVLETT.110.018701
Andrew McCallum, Dayne Freitag, Fernando C. N. Pereira, Maximum Entropy Markov Models for Information Extraction and Segmentation international conference on machine learning. pp. 591- 598 ,(2000)
Andrea Cavagna, Irene Giardina, Francesco Ginelli, Thierry Mora, Duccio Piovani, Raffaele Tavarone, Aleksandra M. Walczak, Dynamical maximum entropy approach to flocking. Physical Review E. ,vol. 89, pp. 042707- 042707 ,(2014) , 10.1103/PHYSREVE.89.042707
Fabrizio Biondi, Axel Legay, Bo Friis Nielsen, Andrzej Wąsowski, Maximizing Entropy over Markov Processes language and automata theory and applications. pp. 128- 140 ,(2013) , 10.1007/978-3-642-37064-9_13
G. Chliamovitch, A. Dupuis, A. Golub, B. Chopard, Improving predictability of time series using maximum entropy methods arXiv: Risk Management. ,(2014) , 10.1209/0295-5075/110/10003
E. T. Jaynes, Information Theory and Statistical Mechanics Physical Review. ,vol. 106, pp. 620- 630 ,(1957) , 10.1103/PHYSREV.106.620
Elad Schneidman, Susanne Still, Michael J. Berry, William Bialek, Network Information and Connected Correlations Physical Review Letters. ,vol. 91, pp. 238701- ,(2003) , 10.1103/PHYSREVLETT.91.238701