Characteristic Features of Rank-Probability Word Distribution in Scientific and Belletristic Literature

作者: Iryna A. Voloshynovska

DOI: 10.1080/09296174.2011.583405

关键词:

摘要: Abstract In the present work, an optimal function for approximation of word probability distribution in natural language is tentatively sought. An analysis Zipf's rank-frequency and its modifications performed. The original Lavalette's law modified to get most accurate language. suggested modification has been tested on a broad variety belletristic scientific texts. Implication text features fitting parameters suggested. conclusions are made general tendencies reasons possible deviations discussed.

参考文章(11)
Ioan-Iovitz Popescu, Gabriel Altmann, Reinhard Köhler, Zipf’s law—another view Quality & Quantity. ,vol. 44, pp. 713- 731 ,(2010) , 10.1007/S11135-009-9234-Y
HERBERT A. SIMON, ON A CLASS OF SKEW DISTRIBUTION FUNCTIONS Biometrika. ,vol. 42, pp. 425- 440 ,(1955) , 10.1093/BIOMET/42.3-4.425
Géza Németh, Csaba Zainkó, Multilingual statistical text analysis, Zipf's law and Hungarian speech generation Acta Linguistica Hungarica. ,vol. 49, pp. 385- 405 ,(2002) , 10.1556/ALING.49.2002.3-4.8
Ramon Ferrer i Cancho, Ricard V. Solé, Two Regimes in the Frequency of Words and the Origins of Complex Lexicons: Zipf’s Law Revisited∗ Journal of Quantitative Linguistics. ,vol. 8, pp. 165- 173 ,(2001) , 10.1076/JQUL.8.3.165.4101
Damiáan H. Zanette, Zipf's law and the creation of musical context Musicae Scientiae. ,vol. 10, pp. 3- 18 ,(2006) , 10.1177/102986490601000101
Victor Kuperman, Productivity in the Internet mailing lists: A bibliometric analysis Journal of the Association for Information Science and Technology. ,vol. 57, pp. 51- 59 ,(2006) , 10.1002/ASI.V57:1
Le Quan Ha, Ji Ming, Elvira I. Sicilia-Garcia, Francis Jack Smith, Extension of Zipf's Law to Word and Character N-grams for English and Chinese International Journal of Computational Linguistics & Chinese Language Processing, Volume 8, Number 1, February 2003: Special Issue on Word Formation and Chinese Language Processing. ,vol. 8, pp. 77- 102 ,(2003)
Marcelo A. Montemurro, Beyond the Zipf–Mandelbrot law in quantitative linguistics Physica A-statistical Mechanics and Its Applications. ,vol. 300, pp. 567- 578 ,(2001) , 10.1016/S0378-4371(01)00355-7
Ioan-Iovitz Popescu, On a Zipf's Law extension to impact factors. glottometrics. ,vol. 6, pp. 83- 93 ,(2003)