Multimodal language processing.
作者： Michael Johnston
DOI:
关键词:
摘要: Multimodal interfaces enable more natural and effective humancomputer interaction by providing multiple channels through which input or output may pass. In order to realize their full potential, they need support not just from modes, but synchronized integration of semantic content different modes. This paper describes a multimodal language processing architecture allows for declarative statement strategies in unification-based grammar formalism. The is currently deployed working system enabling with dynamic maps using speech pen, the approach general supports wide variety other potential interfaces.
isca-speech.org参考文章(10)
Bob Carpenter, The logic of typed feature structures Cambridge Tracts in Theoretical Computer Science 32. ,(1992)
Michelle Wang, Philip R. Cohen, Adam Cheyer, Soon Cheol Baeg, An open agent architecture Morgan Kaufmann Publishers Inc.. pp. 197- 204 ,(1997)
Sharon Oviatt, Multimodal interfaces for dynamic interactive maps Proceedings of the SIGCHI conference on Human factors in computing systems common ground - CHI '96. pp. 95- 102 ,(1996) , 10.1145/238386.238438
Michael Johnston, Philip R. Cohen, David McGee, Sharon L. Oviatt, James A. Pittman, Ira Smith, Unification-based multimodal integration Proceedings of the 35th annual meeting on Association for Computational Linguistics -. pp. 281- 288 ,(1997) , 10.3115/976909.979653
Sharon Oviatt, Antonella DeAngeli, Karen Kuhn, Integration and synchronization of input modes during multimodal human-computer interaction human factors in computing systems. pp. 415- 422 ,(1997) , 10.1145/258549.258821
Kent Wittenburg, Louis Weitzman, Jim Talley, Unification-based grammars and tabular parsing for graphical languages Journal of Visual Languages and Computing. ,vol. 2, pp. 347- 370 ,(1991) , 10.1016/S1045-926X(05)80004-7
Ivan A. Sag, Carl Jesse Pollard, Head-Driven Phrase Structure Grammar ,(1994)
Philip R. Cohen, Michael Johnston, David McGee, Sharon Oviatt, Jay Pittman, Ira Smith, Liang Chen, Josh Clow, QuickSet: multimodal interaction for distributed applications acm multimedia. pp. 31- 40 ,(1997) , 10.1145/266180.266328
Jeannette G. Neal, Stuart C. Shapiro, Intelligent multi-media interface technology intelligent user interfaces. pp. 11- 43 ,(1991) , 10.1145/107215.128690
Michael Johnston, Unification-based Multimodal Parsing meeting of the association for computational linguistics. ,vol. 1, pp. 624- 630 ,(1998) , 10.3115/980845.980949