The Role of Evaluation in the Development of Spoken Language Systems

作者: Wolfgang Minker

DOI: 10.1023/A:1009660908880

关键词:

摘要: In this article, several criteria and paradigms are described tomeasure the performance of spoken language systems developed in theframework national international research projects. Theseevaluations carried out domain spontaneous human-humaninteraction as supported by machine translation systems. They alsoapplied human-machine interactiontypically used information retrieval applications. Some evaluationparadigms discussed more detail. It is also shown that officialperformance tests site-specific evaluation arecomplementary use.

参考文章(21)
Wolfgang Minker, Evaluation methodologies for interactive speech system language resources and evaluation. pp. 199- 208 ,(1998)
Hélène Bonneau-Maynard, Wolfgang Minker, Samir Bennacef, Lori Lamel, Jean-Luc Gauvain, A spoken language system for information retrieval. conference of the international speech communication association. ,(1994)
Martin Oerder, Harald Aust, A realtime prototype of an automatic inquiry system. conference of the international speech communication association. ,(1994)
Donna Gates, Alon Lavie, Lori Levin, Alex Waibel, Marsal Gavaldà, Laura Mayfield, Monika Woszczyna, Puming Zhan, End-to-End Evaluation in JANUS: A Speech-to-speech Translation System Lecture Notes in Computer Science. pp. 195- 206 ,(1996) , 10.1007/3-540-63175-5_47
J. L. Gauvain, S. Bennacef, L. Devillers, L. F. Lamel, S. Rosset, Spoken Language Component of the MASK Kiosk Springer Berlin Heidelberg. pp. 93- 103 ,(1997) , 10.1007/978-3-642-60665-6_11
Judith A. Markowitz, Using speech recognition ,(1995)
Richard Winski, Dafydd Gibbon, Roger Moore, Handbook of standards and resources for spoken language systems Mouton de Gruyter. ,(1997)
W. Minker, S. Bennacef, J.-L. Gauvain, A stochastic case frame approach for natural language understanding international conference on spoken language processing. ,vol. 2, pp. 1013- 1016 ,(1996) , 10.1109/ICSLP.1996.607775
A. Life, I. Salter, J.N. Temem, F. Bernard, S. Rosset, S. Bennacef, L. Lamel, Data collection for the MASK kiosk: WOz vs. prototype system international conference on spoken language processing. ,vol. 3, pp. 1672- 1675 ,(1996) , 10.1109/ICSLP.1996.607947
Bertram Bruce, Case Systems for Natural Language Artificial Intelligence. ,vol. 6, pp. 327- 360 ,(1975) , 10.1016/0004-3702(75)90020-X