Computed Ontology-based Situation Awareness of Multi-User Observations

摘要: In recent years, we have developed a framework of human-computer interaction that offers recognition various communication modalities including speech, lip movement, facial expression, handwriting/drawing, gesture, text and visual symbols. The allows the rapid construction multimodal, multi-device, multi-user system within crisis management. This paper reports approaches used in information integration (input fusion) multimodal presentation (output fission) modules, which can be isolation, but also as part framework. latter is able to specify produce contextsensitive user-tailored output combining language, visual-language graphics. These modules provide channel between users with different devices. By employment ontology, system’s view about world constructed from observations appropriate responses are generated.