Iterative Batch Back-Translation for Neural Machine Translation: A Conceptual Model.

作者: Bashir Shehu Galadanci , Idris Abdulmumin , Abubakar Isa

DOI:

关键词:

摘要: An effective method to generate a large number of parallel sentences for training improved neural machine translation (NMT) systems is the use back-translations target-side monolingual data. Recently, iterative back-translation has been shown outperform standard albeit on some language pairs. This work proposes batch that aimed at enhancing and enabling efficient utilization more After each iteration, new are added data will be used train final forward model. The presents conceptual model proposed approach.

参考文章(24)
Deniz Yuret, Jonathan May, Kevin Knight, Barret Zoph, Transfer Learning for Low-Resource Neural Machine Translation arXiv: Computation and Language. ,(2016)
Melvin Johnson, Mike Schuster, Quoc V Le, Maxim Krikun, Yonghui Wu, Zhifeng Chen, Nikhil Thorat, Fernanda Viégas, Martin Wattenberg, Greg Corrado, Macduff Hughes, Jeffrey Dean, None, Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation Transactions of the Association for Computational Linguistics. ,vol. 5, pp. 339- 351 ,(2017) , 10.1162/TACL_A_00065
Caglar Gulcehre, Orhan Firat, Kelvin Xu, Kyunghyun Cho, Yoshua Bengio, On integrating a language model into neural machine translation Computer Speech & Language. ,vol. 45, pp. 137- 148 ,(2017) , 10.1016/J.CSL.2017.01.014
Yann N. Dauphin, Jonas Gehring, Michael Auli, Denis Yarats, David Grangier, Convolutional Sequence to Sequence Learning arXiv: Computation and Language. ,(2017)
Ashish Vaswani, Jakob Uszkoreit, Noam Shazeer, Illia Polosukhin, Llion Jones, Niki Parmar, Aidan N. Gomez, Lukasz Kaiser, Attention Is All You Need arXiv: Computation and Language. ,(2017)
Mu Li, Shujie Liu, Enhong Chen, Zhirui Zhang, Ming Zhou, Joint Training for Neural Machine Translation Models with Monolingual Data arXiv: Computation and Language. ,(2018)
Andy Way, Peyman Passban, Dimitar Shterionov, Alberto Poncelas, Gideon Maillette de Buy Wenniger, Investigating Backtranslation in Neural Machine Translation arXiv: Computation and Language. ,(2018)
Michael Denkowski, Marine Carpuat, Xing Niu, Bi-Directional Neural Machine Translation with Synthetic Parallel Data arXiv: Computation and Language. ,(2018)
Michael Auli, Myle Ott, Sergey Edunov, David Grangier, Scaling Neural Machine Translation arXiv: Computation and Language. ,(2018)
Ryan Cotterell, Julia Kreutzer, Explaining and Generalizing Back-Translation through Wake-Sleep. arXiv: Computation and Language. ,(2018)