Hand Tracking with a Near-Range Depth Camera for Virtual Object Manipulation in an Wearable Augmented Reality

作者: Gabyong Park , Taejin Ha , Woontack Woo

DOI: 10.1007/978-3-319-07458-0_37

关键词: Augmented realityArtificial intelligenceTracking (particle physics)GestureFocus (computing)Computer graphics (images)Wearable computerComputer scienceComputer visionRotation (mathematics)Virtual imageObject (computer science)

摘要: This paper proposes methods for tracking a bare hand with near-range depth camera attached to video see-through Head-mounted Display HMD virtual object manipulation in an Augmented Reality AR environment. The particular focus herein is upon using gestures that are frequently used daily life. First, we use segment the easily, considering both skin color and information within arms' reaches. Then, fingertip base positions extracted through primitive models of finger palm. According these positions, rotation parameters joints estimated inverse-kinematics algorithm. Finally, user's hands localized from physical space by camera-tracking then 3D manipulation. Our method applicable various interaction scenarios such as digital access/control, creative CG modeling, virtual-hand-guiding, or game UIs.

参考文章(13)
C. W. Wampler, L. J. Leifer, Applications of Damped Least-Squares Methods to Resolved-Rate and Resolved-Acceleration Control of Manipulators Journal of Dynamic Systems, Measurement, and Control. ,vol. 110, pp. 31- 38 ,(1988) , 10.1115/1.3152644
Irene Albrecht, Hans-Peter Seidel, Jörg Haber, Construction and animation of anatomically based human hand models symposium on computer animation. pp. 98- 109 ,(2003) , 10.5555/846276.846290
Iason Oikonomidis, Nikolaos Kyriazis, Antonis Argyros, Efficient Model-based 3D Tracking of Hand Articulations using Kinect british machine vision conference. pp. 1- 11 ,(2011) , 10.5244/C.25.101
Robert Wang, Sylvain Paris, Jovan Popović, 6D hands Proceedings of the 24th annual ACM symposium on User interface software and technology - UIST '11. pp. 549- 558 ,(2011) , 10.1145/2047196.2047269
Robert Y. Wang, Jovan Popović, Real-time hand-tracking with a color glove international conference on computer graphics and interactive techniques. ,vol. 28, pp. 63- ,(2009) , 10.1145/1531326.1531369
Taehee Lee, Tobias Hollerer, Handy AR: Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking international symposium on wearable computers. pp. 1- 8 ,(2007) , 10.1109/ISWC.2007.4373785
I. Oikonomidis, N. Kyriazis, A. A. Argyros, Tracking the articulated motion of two strongly interacting hands computer vision and pattern recognition. pp. 1862- 1869 ,(2012) , 10.1109/CVPR.2012.6247885
Juan Pablo Wachs, Mathias Kölsch, Helman Stern, Yael Edan, None, Vision-based hand-gesture applications Communications of The ACM. ,vol. 54, pp. 60- 71 ,(2011) , 10.1145/1897816.1897838
Foti Coleca, Sascha Klement, Thomas Martinetz, Erhardt Barth, Real-time skeleton tracking for embedded systems Proceedings of SPIE. ,vol. 8667, ,(2013) , 10.1117/12.2003004