Ubii: Physical World Interaction Through Augmented Reality

作者: Sikun Lin , Hao Fei Cheng , Weikai Li , Zhanpeng Huang , Pan Hui

DOI: 10.1109/TMC.2016.2567378

关键词: Human–computer interactionAugmented realityMobile computingInterface (computing)Graphical user interfaceWearable computerEmbedded systemSmart deviceGesturePost-WIMPComputer scienceComputer-mediated realityUser interface

摘要: We describe a new set of interaction techniques that allow users to interact with physical objects through augmented reality (AR). Previously, operate smart device, touch is generally needed and graphical interface normally involved. These become limitations prevent the user from operating device out reach or multiple devices at once. Ubii (Ubiquitous interaction) an integrated system connects network together, allows using hand gestures. The wears glass which displays in view. Hand gestures are captured by glass, upon recognizing right gesture input, will communicate connected complete designated operations. supports common inter-device operations such as file transfer, printing, projecting, well pairing. To improve overall performance system, we implement computation offloading perform image processing computation. Our test shows easy use more intuitive than traditional interfaces. shortens operation time on various tasks involving devices. novel paradigm attains seamless between digital worlds.

参考文章(49)
, SUS: A 'Quick and Dirty' Usability Scale Usability Evaluation in Industry. pp. 207- 212 ,(1996) , 10.1201/9781498710411-35
James Miller, Philip Kortum, Aaron Bangor, Determining what individual SUS scores mean: adding an adjective rating scale Journal of Usability Studies archive. ,vol. 4, pp. 114- 123 ,(2009)
Saurabh Gupta, Ross Girshick, Pablo Arbeláez, Jitendra Malik, Learning Rich Features from RGB-D Images for Object Detection and Segmentation european conference on computer vision. pp. 345- 360 ,(2014) , 10.1007/978-3-319-10584-0_23
G. Csurka, Visual categorization with bags of keypoints european conference on computer vision. ,vol. 1, pp. 22- ,(2004)
Pan Hui, Zhanpeng Huang, Dimitris Chatzopoulos, Christoph Peylo, Mobile augmented reality survey: a bottom-up approach arXiv: Graphics. ,(2013)
Gang Ren, Eamonn O'Neill, Special Section on Touching the 3rd Dimension: 3D selection with freehand gesture Computers & Graphics. ,vol. 37, pp. 101- 120 ,(2013) , 10.1016/J.CAG.2012.12.006
Benjamin D Zarit, Boaz J Super, Francis KH Quek, Comparison of five color models in skin pixel classification international conference on computer vision. pp. 58- 63 ,(1999) , 10.1109/RATFG.1999.799224
Miguel A. Nacenta, Carl Gutwin, Dzmitry Aliakseyeu, Sriram Subramanian, There and Back Again: Cross-Display Object Movement in Multi-Display Environments Human-Computer Interaction. ,vol. 24, pp. 170- 229 ,(2009) , 10.1080/07370020902819882
Jiandong Liang, Mark Green, JDCAD: A highly interactive 3D modeling system computer aided design and computer graphics. ,vol. 18, pp. 499- 506 ,(1994) , 10.1016/0097-8493(94)90062-0
Sean G. Gustafson, Bernhard Rabe, Patrick M. Baudisch, Understanding palm-based imaginary interfaces: the role of visual and tactile cues when browsing human factors in computing systems. pp. 889- 898 ,(2013) , 10.1145/2470654.2466114