Self-adaptive Multimodal User Interfaces based on Interface-Device Binding

摘要: Human-computer interaction (HCI) is concerned with the implementation of interactive computing systems for human use [1]. With the evolution of HCI [2], the focus extended from the concept of “interface” into “interaction revision”[3]. While “interface” means the sets of methods that can be called upon and used by a service,“interaction revision” refers to the procedure by which technology fits in a wide range of human needs, rather than what the interface looks like. HCI [4, 5] introduces also the concept of “multimodal user interfaces”, the basic idea of which is motivated by the knowledge of natural human communication, which makes use of the different modalities available. The future use of multimodal user interface based services will be driven by 1) mobile and wireless technologies, aiming to provide any-time and any-where services, and 2) ubiquitous and pervasive computing, allowing applications to be jointly operated through multi interface devices located inside the service area. User and Terminal mobility form a dynamic environment in which interface devices may appear and disappear depending on the facilities and (device) availability within the environment. To customise such service and to resolve an arbitrary interface change, raises a number of difficulties 1) to maintain a level of quality of the service in a random interface change scenario, 2) to provide the service that satisfies user preferences, 3) to support real time adaptive interface service and 4) to transform data content from a current modality to another modality offered by a different device [6, 7]. These problems are caused by 1) the limited capability of small portable devices …