Dynamic Facial Expression Understanding Using Deep Spatiotemporal LDSP On Spark

作者: Kyung-Ah Sohn , Azher Uddin , Joolekha Bibi Joolee

DOI: 10.1109/ACCESS.2021.3053276

关键词:

摘要: Facial expressions are the most common medium for expressing human emotions. Due to wide range of real-world applications, facial expression understanding has received extensive attention from researchers. One vital issues recognition is extraction and modeling temporal dynamics emotions videos. Additionally, rapid growth video data various multimedia sources becoming a serious concern. Therefore, address these issues, in this paper, we introduce novel approach on top Spark First, propose new dynamic feature descriptor, namely, local directional structural pattern three orthogonal planes (LDSP-TOP), which analyzes aspects texture. Second, design 1-D convolutional neural network (CNN) capture additional discriminative features. Third, long short-term memory (LSTM) autoencoder employed learn spatiotemporal Finally, an experimental investigation carried out demonstrate performance scalability proposed framework.

参考文章(46)
Md Azher Uddin, Joolekha Bibi Joolee, Young-Koo Lee, Depression Level Prediction Using Deep Spatiotemporal Features and Multilayer Bi-LTSM IEEE Transactions on Affective Computing. pp. 1- 1 ,(2020) , 10.1109/TAFFC.2020.2970418
Nguyen Anh Tu, Thien Huynh-The, Kok-Seng Wong, Dinh-Mao Bui, Young-Koo Lee, Distributed Feature Extraction on Apache Spark for Human Action Recognition international conference on ubiquitous information management and communication. pp. 9001680- ,(2020) , 10.1109/IMCOM48794.2020.9001680
Md Azher Uddin, Young-Koo Lee, Dynamic Facial Emotion Recognition Using Deep Spatial Feature and Handcrafted Spatiotemporal Feature on Spark 2020 IEEE International Conference on Big Data and Smart Computing (BigComp). pp. 21- 27 ,(2020) , 10.1109/BIGCOMP48618.2020.0-104
Md Anwarul Islam, Md Azher Uddin, Young-Koo Lee, A Distributed Automatic Video Annotation Platform Applied Sciences. ,vol. 10, pp. 5319- ,(2020) , 10.3390/APP10155319
Shan Li, Weihong Deng, Deep Facial Expression Recognition: A Survey IEEE Transactions on Affective Computing. pp. 1- 1 ,(2020) , 10.1109/TAFFC.2020.2981446
Du Tran, Lubomir Bourdev, Rob Fergus, Lorenzo Torresani, Manohar Paluri, Learning Spatiotemporal Features with 3D Convolutional Networks 2015 IEEE International Conference on Computer Vision (ICCV). pp. 4489- 4497 ,(2015) , 10.1109/ICCV.2015.510
Taskeed Jabid, Md Hasanul Kabir, Oksam Chae, Robust Facial Expression Recognition Based on Local Directional Pattern ETRI Journal. ,vol. 32, pp. 784- 794 ,(2010) , 10.4218/ETRIJ.10.1510.0132
Abhinav Dhall, Roland Goecke, Simon Lucey, Tom Gedeon, Collecting Large, Richly Annotated Facial-Expression Databases from Movies IEEE MultiMedia. ,vol. 19, pp. 34- 41 ,(2012) , 10.1109/MMUL.2012.26
Guoying Zhao, Xiaohua Huang, Matti Taini, Stan Z. Li, Matti Pietikäinen, Facial expression recognition from near-infrared videos Image and Vision Computing. ,vol. 29, pp. 607- 619 ,(2011) , 10.1016/J.IMAVIS.2011.07.002
Xiangxin Zhu, D. Ramanan, Face detection, pose estimation, and landmark localization in the wild computer vision and pattern recognition. pp. 2879- 2886 ,(2012) , 10.1109/CVPR.2012.6248014