An implementation of sign language alphabet hand posture recognition using geometrical features through artificial neural network (part 2)

作者: David Tully , Hoshang Kolivand , Saba Joudaki , Mohd Shahrizal Sunar

DOI: 10.1007/S00521-021-06025-3

关键词:

摘要: In the sign language alphabet, several hand signs are in use. Automatic recognition of performed can facilitate communication between hearing and none people. This framework proposes posture American Sign Language alphabet based on a neural network (NN) which works geometrical feature extraction hand. The user’s is captured by 3D depth-based sensor camera. Consequently, segmented according to depth features. proposed system called ‘Depth-based Geometrical Recognition’ (DGSLR). DGSLR adopted an easier segmentation approach, further used other applications. improves accuracy due unchangeable features against orientation or rotation compared Discrete Cosine Transform (DCT) Moment Invariant. As support vector machine (SVM) type artificial (ANN), it drive desired outcomes. Since there 26 different multi-class SVM versus single classifier with classes RBF kernel was validate each class. proficient provides up 96.78%. findings iterations demonstrated that combination extracted resulted better rate process classification step.

参考文章(27)
P V.V, P.Rajesh Kumar, Segment, Track, Extract, Recognize and Convert Sign Language Videos to Voice/Text International Journal of Advanced Computer Science and Applications. ,vol. 3, ,(2012) , 10.14569/IJACSA.2012.030608
Elena Mugellini, Julien Tscherrig, Omar Abou Khaled, Maurizio Caon, Yong Yue, Context-Aware 3D Gesture Interaction Based on Multiple Kinects AMBIENT 2011, The First International Conference on Ambient Computing, Applications, Services and Technologies. pp. 7- 12 ,(2011)
Hsi-Chieh Lee, Che-Yu Shih, Tzu-Miao Lin, None, Computer-Vision Based Hand Gesture Recognition and Its Application in Iphone Advances in Intelligent Systems and Applications - Volume 2. pp. 487- 497 ,(2013) , 10.1007/978-3-642-35473-1_49
Cem Keskin, Furkan Kıraç, Yunus Emre Kara, Lale Akarun, Hand pose estimation and hand shape classification using multi-layered randomized decision forests european conference on computer vision. pp. 852- 863 ,(2012) , 10.1007/978-3-642-33783-3_61
Shutao Li, Hui Lin, Li Chen, Depth image enhancement for Kinect using region growing and bilateral filter international conference on pattern recognition. pp. 3070- 3073 ,(2012)
Steven L. Eddins, Rafael C. Gonzalez, Richard E. Woods, Digital Image Processing Using Matlab ,(2006)
Cao Dong, Ming C. Leu, Zhaozheng Yin, American Sign Language alphabet recognition using Microsoft Kinect computer vision and pattern recognition. ,vol. 2015, pp. 44- 52 ,(2015) , 10.1109/CVPRW.2015.7301347
Hui Liang, Junsong Yuan, Daniel Thalmann, Parsing the Hand in Depth Images IEEE Transactions on Multimedia. ,vol. 16, pp. 1241- 1253 ,(2014) , 10.1109/TMM.2014.2306177
Nicolas Pugeault, Richard Bowden, Spelling it out: Real-time ASL fingerspelling recognition international conference on computer vision. pp. 1114- 1119 ,(2011) , 10.1109/ICCVW.2011.6130290
John G. Daugman, Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. Journal of The Optical Society of America A-optics Image Science and Vision. ,vol. 2, pp. 1160- 1169 ,(1985) , 10.1364/JOSAA.2.001160