2.5DHANDS: a gesture-based MR remote collaborative platform

摘要: Current remote collaborative systems in manufacturing are mainly based on video-conferencing technology. Their primary aim is to transmit process knowledge between experts and local workers. However, it does not provide the with same hands-on experience as when synergistically working site person. The mixed reality (MR) increasing networking performances have capacity enhance communication collaborators geographically distributed locations. In this paper, therefore, we propose a new gesture-based platform using MR technology that enables expert collaborate workers physical tasks. Besides, concentrate assembly an illustrative use case. key advantage compared other interfaces projects expert’s gestures into real worksite improve performance, co-presence awareness, user collaboration experience. We study effects of sharing projector-based system manufacturing. Furthermore, show capabilities our framework prototype consisting VR HMD, Leap Motion, projector. was evaluated pilot comparing POINTER (adding AR annotations task space view through mouse), which most popular method used augment at present. assessment adopts following aspects: user’s satisfaction, user-perceived quality terms interaction cooperation. Our results demonstrate clear difference 2.5DHANDS interface performance time. Additionally, statistically significantly higher than awareness attention, manipulation, self-confidence, co-presence.