Multimodal Interfaces: A Survey of Principles, Models and Frameworks

摘要: The grand challenge of multimodal interface creation is to build reliable processing systems able analyze and understand multiple communication means in real-time. This opens a number associated issues covered by this chapter, such as heterogeneous data types fusion, architectures for real-time processing, dialog management, machine learning interaction, modeling languages, frameworks, etc. chapter does not intend cover exhaustively all the related interfaces some hot topics, error handling, have been left aside. starts with features advantages focus on particular findings guidelines, well cognitive foundations underlying interaction. then focuses driving theoretical principles, time-sensitive software fusion fission issues. Modeling interaction tools allowing rapid are presented. article concludes an outline current state research Switzerland, also summarizes major future challenges field.