A Study of Translation Edit Rate with Targeted Human Annotation

作者: Matthew Snover , Bonnie Dorr , Richard Schwartz , Linnea Micciulla , John Makhoul

DOI:

关键词:

摘要: … -determined, or untargeted, reference trans… untargeted reference(s). We then compute the minimum TER (using the technique described above in Section 3) using this single targeted …

参考文章(11)
Lezan Hawizy, Somayajulu G. Sripada, Ehud Reiter, Evaluating an NLG system using post-editing international joint conference on artificial intelligence. pp. 1700- 1701 ,(2005)
Joseph P. Turian, Luke Shea, I. D. Melamed, Evaluation of Machine Translation and its Evaluation Defense Technical Information Center. ,(2006) , 10.21236/ADA453509
Gregor Leusch, Sonja Nießen, Franz Josef Och, Hermann Ney, An Evaluation Tool for Machine Translation: Fast Evaluation for MT Research language resources and evaluation. ,(2000)
Margaret King, Evaluating natural language processing systems Communications of the ACM. ,vol. 39, pp. 73- 79 ,(1996) , 10.1145/234173.234208
Robert Frederking, Sergei Nirenburg, Three Heads are Better than One conference on applied natural language processing. pp. 95- 100 ,(1994) , 10.3115/974358.974380
Dana Shapira, James A. Storer, Edit distance with move operations Journal of Discrete Algorithms. ,vol. 5, pp. 380- 392 ,(2007) , 10.1016/J.JDA.2005.01.010
George Doddington, Automatic evaluation of machine translation quality using n-gram co-occurrence statistics international conference on human language technology research. pp. 138- 145 ,(2002) , 10.3115/1289189.1289273
Alon Lavie, Satanjeev Banerjee, METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments meeting of the association for computational linguistics. pp. 65- 72 ,(2005)
INDERJEET MANI, GARY KLEIN, DAVID HOUSE, LYNETTE HIRSCHMAN, THERESE FIRMIN, BETH SUNDHEIM, SUMMAC: a text summarization evaluation Natural Language Engineering. ,vol. 8, pp. 43- 68 ,(2002) , 10.1017/S1351324901002741
Grazia Russo-Lassner, Jimmy Lin, Philip Resnik, A Paraphrase-Based Approach to Machine Translation Evaluation Defense Technical Information Center. ,(2005) , 10.21236/ADA448032