Creating conversational interfaces for children

作者: S. Narayanan , A. Potamianos

DOI: 10.1109/89.985544

关键词: Natural languageSpoken languageComputer scienceUser interface designUser interfaceGraphical user interfaceAdaptation (computer science)Speech recognitionComputer gameLanguage model

摘要: Creating conversational interfaces for children is challenging in several respects. These include acoustic modeling automatic speech recognition (ASR), language and dialog modeling, multimodal-multimedia user interface design. First, issues ASR of children's are introduced by an analysis developmental changes the spectral temporal characteristics signal using data obtained from 456 children, ages five to 18 years. Acoustic adaptation vocal tract normalization algorithms that yielded state-of-the-art performance on described. Second, experiment designed better understand how interact with machines spoken Realistic multimedia interaction were 160 who played a voice-activated computer game Wizard Oz (WoZ) scenario. Results these developing novel models as well unified maximum likelihood framework decoding semantic classification understanding Leveraging lessons learned WoZ study concurrent experience evaluation, personal agent prototype was designed. Details architecture application details Informal evaluation found positive especially animated interface.

参考文章(27)
Alexandros Potamianos, Chin-Hui Lee, Andrew Pargellis, Antoine Saad, Qiru Zhou, Hong-Kwang Kuo, DESIGN PRINCIPLES AND TOOLS FOR MULTIMODAL DIALOG SYSTEMS ,(2000)
Toshiyuki Takezawa, Tsuyoshi Morimoto, A multimodal-input multimedia-output guidance system: MMGS. conference of the international speech communication association. ,(1998)
Alexandros Potamianos, Sungbok Lee, Shrikanth S. Narayanan, Automatic speech recognition for children. conference of the international speech communication association. ,(1997)
Roberto Pieraccini, Wieland Eckert, Esther Levin, AMICA: the AT&t mixed initiative conversational architecture. conference of the international speech communication association. ,(1997)
Sudha Arunachalam, Elaine Andersen, Shrikanth S. Narayanan, Dani Byrd, Dylan Gould, Politeness and frustration language in child-machine interactions conference of the international speech communication association. pp. 2675- 2678 ,(2001)
Josh Clow, Ira A. Smith, Philip R. Cohen, Michael Johnston, Sharon L. Oviatt, David McGee, The efficiency of multimodal interaction: a case study. conference of the international speech communication association. ,(1998)
Ursula Gisela Goldstein, An articulatory model for the vocal tracts of growing children Massachusetts Institute of Technology. ,(1980)
S Eguchi, I J Hirsh, Development of speech sounds in children. Acta Oto-laryngologica. ,vol. 257, pp. 1- 51 ,(1969)
Lawrence Rabiner, Biing-Hwang Juang, Fundamentals of speech recognition ,(1993)
Roberto Pieraccini, Giuseppe Di Fabbrizio, Konstantin Biatov, Wieland Eckert, P. Ruscitti, Mazin G. Rahim, Esther Levin, Marilyn A. Walker, Sungbok Lee, Shrikanth S. Narayanan, Enrico Bocchieri, A. Pokrovsky, The AT&t-DARPA communicator mixed-initiative spoken dialog system. conference of the international speech communication association. pp. 122- 125 ,(2000)