A virtual touchscreen with depth recognition

作者: Burkhard C. Wünsche , Gabriel Hartmann

DOI:

关键词:

摘要: While touch interfaces have become more popular, they are still mostly confined to mobile platforms such as smart phones and notebooks. Mouse dominate desktop due their portability, ergonomic design large number of possible interactions. In this paper we present a prototype for new interface based on cheap consumer-level hardware, which combines advantages the mouse interface, but additionally allows detection 3D depth values. This is achieved by using web cam point light source detecting hand shadow gestures in order compute finger tip positions. Our evaluation shows that concept feasible powerful interactions than with traditional can be achieved. Limitations include reduced input precision, insufficient stability utilised computer vision algorithms, requirement stable lighting environment.

参考文章(29)
Burkhard C. Wünsche, Rong Yang, Life-sketch: a framework for sketch-based modelling and animation of 3D objects australasian user interface conference. pp. 61- 70 ,(2010)
Ivan Laptev, Tony Lindeberg, Tracking of Multi-state Hand Models Using Particle Filtering and a Hierarchy of Multi-scale Image Features Lecture Notes in Computer Science. ,vol. 2106, pp. 63- 74 ,(2001) , 10.1007/3-540-47778-0_6
Peng Song, Stefan Winkler, Syed Omer Gilani, ZhiYing Zhou, Vision-based projected tabletop interface for finger interactions international conference on human computer interaction. pp. 49- 58 ,(2007) , 10.1007/978-3-540-75773-3_6
Vladimir Vezhnevets, Vassili Sazonov, Alla Andreeva, A Survey on Pixel-Based Skin Color Detection Techniques ,(2003)
Ei-ichi Takenaka, Kazuhiro Homma, An Image Processing Method for Feature Extraction of Space-Occupying Lesions The Journal of Nuclear Medicine. ,vol. 26, pp. 1472- 1477 ,(1985)
Shahzad Malik, Joe Laszlo, Visual touchpad: a two-handed gestural input device international conference on multimodal interfaces. pp. 289- 296 ,(2004) , 10.1145/1027933.1027980
P. Kakumanu, S. Makrogiannis, N. Bourbakis, A survey of skin-color modeling and detection methods Pattern Recognition. ,vol. 40, pp. 1106- 1122 ,(2007) , 10.1016/J.PATCOG.2006.06.010
Celine Latulipe, Stephen Mann, Craig S. Kaplan, Charlie L. A. Clarke, symSpline: symmetric two-handed spline manipulation human factors in computing systems. pp. 349- 358 ,(2006) , 10.1145/1124772.1124825
Kazuhiro Terajima, Takashi Komuro, Masatoshi Ishikawa, Fast finger tracking system for in-air typing interface Proceedings of the 27th international conference extended abstracts on Human factors in computing systems - CHI EA '09. pp. 3739- 3744 ,(2009) , 10.1145/1520340.1520564
F. Mahmoudi, M. Parviz, Visual Hand Tracking Algorithms geometric modeling and imaging. pp. 228- 232 ,(2006) , 10.1109/GMAI.2006.48