Novel Framework for Outdoor Mobility Assistance and Auditory Display for Visually Impaired People

作者: Wasiq Khan , Abir Hussain , Bilal Khan , Raheel Nawaz , Thar Baker

DOI: 10.1109/DESE.2019.00183

关键词: Process (computing)Data stream miningFeature extractionComputer scienceReliability (computer networking)Auditory displayWearable computerObstacleHuman–computer interactionSpatial analysis

摘要: Outdoor mobility of Visually Impaired People (VIPs) has always been challenging due to the dynamically varying scenes and environmental states. Variety systems have introduced assist VIPs’ that include sensor mounted canes use machine intelligence. However, these are not reliable when used navigate VIPs in changing environments. The associated challenges robust sensing avoiding diverse types obstacles, modelling states (e.g. moving objects, road-works), effective communication interpret hazards. In this paper, we propose an intelligent wearable auditory display framework will process real-time video multi-sensor data streams to: a) identify type b) recognize surrounding scene/objects corresponding attributes geometry, size, shape, distance from user), c) automatically generate descriptive information about recognized obstacle/objects attributes, d) produce accurate, precise spatial instructions audio-visual form safely with or without assistance traditional means.

参考文章(34)
Riza Theresa Batista-Navarro, Georgios Kontonatsios, Claudiu Mihăilă, Paul Thompson, Rafal Rak, Raheel Nawaz, Ioannis Korkontzelos, Sophia Ananiadou, Facilitating the analysis of discourse phenomena in an interoperable NLP platform international conference on computational linguistics. pp. 559- 571 ,(2013) , 10.1007/978-3-642-37247-6_45
Liam Betsworth, Nitendra Rajput, Saurabh Srivastava, Matt Jones, Audvert: Using Spatial Audio to Gain a Sense of Place international conference on human-computer interaction. pp. 455- 462 ,(2013) , 10.1007/978-3-642-40498-6_35
A. J. Aljaaf, D. Al-Jumeily, A. J. Hussain, T. Dawson, P Fergus, M. Al-Jumaily, Predicting the likelihood of heart failure with a multi level risk assessment using decision tree international conference on technological advances in electrical electronics and computer engineering. pp. 101- 106 ,(2015) , 10.1109/TAEECE.2015.7113608
Sophia Ananiadou, Paul Thompson, Raheel Nawaz, Enhancing search: events and their discourse context international conference on computational linguistics. pp. 318- 334 ,(2013) , 10.1007/978-3-642-37256-8_27
Kumar Yelamarthi, Daniel Haas, Daniel Nielsen, Shawn Mothersell, RFID and GPS integrated navigation system for the visually impaired international midwest symposium on circuits and systems. pp. 1149- 1152 ,(2010) , 10.1109/MWSCAS.2010.5548863
Jizhong Xiao, Kevin Ramdath, Manor Iosilevish, Dharmdeo Sigh, Anastasis Tsakas, A low cost outdoor assistive navigation system for blind people conference on industrial electronics and applications. pp. 828- 833 ,(2013) , 10.1109/ICIEA.2013.6566481
Matthew Brown, Sabine Susstrunk, Multi-spectral SIFT for scene category recognition CVPR 2011. pp. 177- 184 ,(2011) , 10.1109/CVPR.2011.5995637
Abdul Hakim H. M. Mohamed, Hissam Tawfik, Dhiya Al-Jumeily, Lin Norton, MoHTAM: A Technology Acceptance Model for Mobile Health Applications 2011 Developments in E-systems Engineering. pp. 13- 18 ,(2011) , 10.1109/DESE.2011.79
Chaitanya P. Gharpure, Vladimir A. Kulyukin, Robot-assisted shopping for the blind: issues in spatial cognition and product selection Intelligent Service Robotics. ,vol. 1, pp. 237- 251 ,(2008) , 10.1007/S11370-008-0020-9
Raphaël Labayrade, Cyril Royere, Dominique Gruyer, Didier Aubert, Cooperative Fusion for Multi-Obstacles Detection With Use of Stereovision and Laser Scanner Autonomous Robots. ,vol. 19, pp. 117- 140 ,(2005) , 10.1007/S10514-005-0611-7