Multi‐dimensional data modelling of video image action recognition and motion capture in deep learning framework

作者: Peijun Gao , Dan Zhao , Xuanang Chen

DOI: 10.1049/IET-IPR.2019.0588

关键词:

摘要: In order to improve the accuracy of small-range human motion recognition in video and computational efficiency large-scale data sets, a multi-dimensional model capture image based on deep-learning framework was proposed. First, moving foreground target is extracted by Gauss mixture model, body recognised gradient histogram. At second level, dense trajectory feature deep learning are fused, according integration global encoding algorithm convolutional neural network. feature, fusion RGB tricolour taken as learning. Finally, classification network model. The simulation experiments real sets small-scale gesture show that has high for actions. addition, Imperial Computer Vision & Learning Lab behaviour set used classify experimental data. average 85.79%. can run at speed about 20 frames per second.

参考文章(18)
Sean Ryan Fanello, Ilaria Gori, Giorgio Metta, Francesca Odone, Keep It Simple and Sparse: Real-Time Action Recognition Gesture Recognition. ,vol. 14, pp. 303- 328 ,(2017) , 10.1007/978-3-319-57021-1_10
Jianjun Li, Xia Mao, Xingyu Wu, Xiaogeng Liang, Human action recognition based on tensor shape descriptor Iet Computer Vision. ,vol. 10, pp. 905- 911 ,(2016) , 10.1049/IET-CVI.2016.0048
Bowen Yang, Haiwei Dong, Abdulmotaleb El Saddik, Development of a Self-Calibrated Motion Capture System by Nonlinear Trilateration of Multiple Kinects v2 IEEE Sensors Journal. ,vol. 17, pp. 2481- 2491 ,(2017) , 10.1109/JSEN.2017.2671420
Trent M Guess, Swithin Razu, Amirhossein Jahandar, Marjorie Skubic, Zhiyu Huo, None, Comparison of 3D Joint Angles Measured With the Kinect 2.0 Skeletal Tracker Versus a Marker-Based Motion Capture System Journal of Applied Biomechanics. ,vol. 33, pp. 176- 181 ,(2017) , 10.1123/JAB.2016-0107
Angelos Karatsidis, Giovanni Bellusci, H Martin Schepers, Mark De Zee, Michael S Andersen, Peter H Veltink, None, Estimation of Ground Reaction Forces and Moments During Gait Using Only Inertial Motion Capture Sensors. ,vol. 17, pp. 75- ,(2016) , 10.3390/S17010075
Andrew R. Novak, Kyle J. M. Bennett, Job Fransen, Ben J. Dascombe, A multidimensional approach to performance prediction in Olympic distance cross-country mountain bikers Journal of Sports Sciences. ,vol. 36, pp. 1- 8 ,(2018) , 10.1080/02640414.2017.1280611
Michael Madigan, A Note from Michael Madigan, JAB’s New Editor-in-Chief Journal of Applied Biomechanics. ,vol. 33, pp. 1- 1 ,(2017) , 10.1123/JAB.2017-0010
Yejin Kim, Seongmin Baek, Byung-Chull Bae, Motion Capture of the Human Body Using Multiple Depth Sensors Etri Journal. ,vol. 39, pp. 181- 190 ,(2017) , 10.4218/ETRIJ.17.2816.0045
Sohaib Laraba, Mohammed Brahimi, Joëlle Tilmanne, Thierry Dutoit, 3D skeleton‐based action recognition by representing motion capture sequences as 2D‐RGB images Computer Animation and Virtual Worlds. ,vol. 28, ,(2017) , 10.1002/CAV.1782