A gesture- and head-based multimodal interaction platform for MR remote collaboration
作者： Peng Wang , Shusheng Zhang , Xiaoliang Bai , Mark Billinghurst , Li Zhang
DOI: 10.1007/S00170-019-04434-2
关键词:
摘要: In this paper, we present a projector-based mixed reality (MR) remote collaborative system which enables users to collaboratively work on physical task using gesture and head pointing (GHP). Using platform, studied the effects of GHP in typical manufacturing use case. Our supports natural intuitive multimodal interaction based GHP, it can project user’s into local environment enhance collaboration. prototype was compared with an augmented (AR) condition (ANNOTATION), is most popular method currently for AR/MR We found significant difference between ANNOTATION conditions terms performance. The significantly improved experience (e.g., awareness attention), empathy co-presence), interaction. Moreover, discuss implications research directions future research.
springer.com
sci-hub.se 参考文章(44)
Matthew Tait, Mark Billinghurst, The Effect of View Independence in a Collaborative AR System conference on computer supported cooperative work. ,vol. 24, pp. 563- 589 ,(2015) , 10.1007/S10606-015-9231-8
Frank Biocca, Chad Harms, Internal Consistency and Reliability of the Networked MindsMeasure of Social Presence ,(2004)
David Kirk, Andy Crabtree, Tom Rodden, Ways of the hands european conference on computer supported cooperative work. pp. 1- 21 ,(2005) , 10.1007/1-4020-4023-7_1
Pavel Gurevich, Joel Lanir, Benjamin Cohen, Design and Implementation of TeleAdvisor: a Projection-Based Augmented Reality System for Remote Collaboration conference on computer supported cooperative work. ,vol. 24, pp. 527- 562 ,(2015) , 10.1007/S10606-015-9232-7
David Kirk, Tom Rodden, Danaë Stanton Fraser, Turn it this way: grounding collaborative action with remote gestures human factors in computing systems. pp. 1039- 1048 ,(2007) , 10.1145/1240624.1240782
Leila Alem, Jane Li, A study of gestures in a video-mediated collaborative assembly task Advances in Human-computer Interaction. ,vol. 2011, pp. 1- 7 ,(2011) , 10.1155/2011/987830
David Kirk, Danae Stanton Fraser, Comparing remote gesture technologies for supporting collaborative physical tasks human factors in computing systems. pp. 1191- 1200 ,(2006) , 10.1145/1124772.1124951
S. K. Ong, M. L. Yuan, A. Y. C. Nee, Augmented reality applications in manufacturing: a survey International Journal of Production Research. ,vol. 46, pp. 2707- 2742 ,(2008) , 10.1080/00207540601064773
Jacki O'Neill, Stefania Castellani, Frederic Roulland, Nicolas Hairon, Cornell Juliano, Liwei Dai, From ethnographic study to mixed reality: a remote collaborative troubleshooting system conference on computer supported cooperative work. pp. 225- 234 ,(2011) , 10.1145/1958824.1958859
Pavel Gurevich, Joel Lanir, Benjamin Cohen, Ran Stone, TeleAdvisor Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12. pp. 619- 622 ,(2012) , 10.1145/2207676.2207763