Maximum Entropy Modeling: A Suitable Framework to Learn Context-Dependent Lexicon Models for Statistical Machine Translation

作者: Ismael García-Varea , Francisco Casacuberta

DOI: 10.1007/S10994-005-0915-Z

关键词:

摘要: Current statistical machine translation systems are mainly based on word lexicons. However, these models usually context-independent, therefore, the disambiguation of a source must be carried out using other probabilistic distributions (distortion and language models). One efficient way to add contextual information lexicons is maximum entropy modeling. In that framework, context introduced through feature functions allow us automatically learn context-dependent lexicon models. In first approach, modeling after process learning standard (alignment lexicon). second integrated in expectation-maximization models. Experimental results were obtained for two well-known tasks, French--English Canadian Parliament Hansards task German--English Verbmobil task. These proved use both approaches, can help improve performance systems.

参考文章(39)
P. Brezillon, P. Bouquet, Lecture Notes in Artificial Intelligence ,(1999)
Francisco Casacuberta, Jesús Tomás, MONOTONE STATISTICAL TRANSLATION USING WORD GROUPS ,(2001)
Christoph Tillmann, Hermann Ney, Selection criteria for word trigger pairs in language modelling international colloquium on grammatical inference. pp. 95- 106 ,(1996) , 10.1007/BFB0033345
Wolfgang Wahlster, None, Verbmobil : foundations of speech-to-speech translation Springer Berlin Heidelberg. ,(2000) , 10.1007/978-3-662-04230-4
Ismael García Varea, Franz J. Och, Hermann Ney, Francisco Casacuberta, Efficient Integration of Maximum Entropy Lexicon Models within the Training of Statistical Alignment Models conference of the association for machine translation in the americas. pp. 54- 63 ,(2002) , 10.1007/3-540-45820-4_6
Adwait Ratnaparkhi, A Maximum Entropy Model for Part-Of-Speech Tagging empirical methods in natural language processing. ,(1996)
Philipp Koehn, Kevin Knight, Statistical Machine Translation ,(2010)
Adwait Ratnaparkhi, Learning to Parse Natural Language with Maximum Entropy Models Machine Learning. ,vol. 34, pp. 151- 175 ,(1999) , 10.1023/A:1007502103375