Emerging Natural User Interfaces in Mobile Computing: A Bottoms-Up Survey

作者: Pan Hui , Kirill A. Shatilov , Dimitris Chatzopoulos , Lik-Hang Lee

DOI:

关键词: Mobile technologyMobile deviceWearable computerWearable technologyMobile computingMetaverseHuman–computer interactionComputer scienceUser interfaceVirtual reality

摘要: Mobile and wearable interfaces interaction paradigms are highly constrained by the available screen real estate, computational power resources. Although there exist many ways of displaying information to mobile users, inputting data a device is, usually, limited conventional touch based interaction, that distracts users from their ongoing activities. Furthermore, emerging applications, like augmented, mixed virtual reality (AR/MR/VR), require new types input methods in order interact with complex worlds, challenging traditional techniques Human-Computer Interaction (HCI). Leveraging Natural User Interfaces (NUIs), as paradigm using natural intuitive actions computing systems, is one meet these challenges its modern applications. Brain-Machine enable thought-only hands-free Myoelectric track body gestures gaze-tracking - examples NUIs applicable interactions. The wide adoption devices penetration technologies, alongside growing market AR/MR/VR, motivates exploration implementation paradigms. concurrent development bio-signal acquisition accompanying ecosystems offers useful toolbox address open challenges. In this survey, we present state-of-the-art methods, summarize evaluate recent developments area outline potential application scenarios. survey will provide bottoms-up overview starting (i) underlying biological aspects signal techniques, (ii) portable NUI hardware solutions, (iii) NUI-enabled well (iv) research problems.

参考文章(86)
Kusuma Mohanchandra, Snehanshu Saha, G. M. Lingaraju, EEG Based Brain Computer Interface for Speech Communication: Principles and Applications Brain-Computer Interfaces. pp. 273- 293 ,(2015) , 10.1007/978-3-319-10978-7_10
Alice F. Jackson, Donald J. Bolger, The neurophysiological bases of EEG and EEG measurement: a review for the rest of us. Psychophysiology. ,vol. 51, pp. 1061- 1071 ,(2014) , 10.1111/PSYP.12283
Boris B. Velichkovsky, Mikhail A. Rumyantsev, Mikhail A. Morozov, New Solution to the Midas Touch Problem: Identification of Visual Commands Via Extraction of Focal Fixations international conference on interaction design & international development. ,vol. 39, pp. 75- 82 ,(2014) , 10.1016/J.PROCS.2014.11.012
Jonathan Mercier-Ganady, Maud Marchal, Anatole Lécuyer, B-C-invisibility power: introducing optical camouflage based on mental activity in augmented reality augmented human international conference. pp. 97- 100 ,(2015) , 10.1145/2735711.2735835
Jiaxin Ma, Yu Zhang, Andrzej Cichocki, Fumitoshi Matsuno, A Novel EOG/EEG Hybrid Human–Machine Interface Adopting Eye Movements and ERPs: Application to Robot Control IEEE Transactions on Biomedical Engineering. ,vol. 62, pp. 876- 889 ,(2015) , 10.1109/TBME.2014.2369483
Moritz Kassner, William Patera, Andreas Bulling, Pupil: an open source platform for pervasive eye tracking and mobile gaze-based interaction ubiquitous computing. pp. 1151- 1160 ,(2014) , 10.1145/2638728.2641695
CE Shennon, Warren Weaver, A mathematical theory of communication Bell System Technical Journal. ,vol. 27, pp. 379- 423 ,(1948) , 10.1002/J.1538-7305.1948.TB01338.X
Charlotte M. Reed, Nathaniel I. Durlach, Note on Information Transfer Rates in Human Communication Presence: Teleoperators & Virtual Environments. ,vol. 7, pp. 509- 518 ,(1998) , 10.1162/105474698565893
Suzana Herculano-Houzel, The human brain in numbers: a linearly scaled-up primate brain Frontiers in Human Neuroscience. ,vol. 3, pp. 31- 31 ,(2009) , 10.3389/NEURO.09.031.2009
Faizan Haque, Mathieu Nancel, Daniel Vogel, Myopoint: Pointing and Clicking Using Forearm Mounted Electromyography and Inertial Motion Sensors human factors in computing systems. pp. 3653- 3656 ,(2015) , 10.1145/2702123.2702133