Frustratingly Easy Personalization for Real-time Affect Interpretation of Facial Expression

作者: Samuel Spaulding , Cynthia Breazeal

DOI: 10.1109/ACII.2019.8925515

关键词:

摘要: In recent years, researchers have developed technology to analyze human facial expressions and other affective data at very high time resolution. This is enabling develop study interactive robots that are increasingly sensitive their interaction partners' states. However, typical planning models algorithms operate on timescales frequently orders of magnitude larger than the which real-time affect sensed. To bridge this gap between scales sensor collection modeling, must be aggregated interpreted over longer timescales. paper we clarify formalize computational task interpretation in context an educational game played by a robot, during expression sensed, interpreted, used predict partner's gameplay behavior. We compare different techniques for interpretation, generate sets labels modeling inference task, evaluate how generated each technique impact model training inference. show incorporating simple method personalization into process - dynamically calculating applying personalized threshold determining feature leads significant improvement quality inference, comparable performance gains from pre-processing steps such as smoothing via median filter. discuss implications these findings future development affect-aware propose guidelines use methods scenarios.

参考文章(30)
Kunxia Wang, Ning An, Bing Nan Li, Yanyong Zhang, Lian Li, Speech Emotion Recognition Using Fourier Parameters IEEE Transactions on Affective Computing. ,vol. 6, pp. 69- 75 ,(2015) , 10.1109/TAFFC.2015.2392101
Ginevra Castellano, Iolanda Leite, André Pereira, Carlos Martinho, Ana Paiva, Peter W. Mcowan, Context-Sensitive Affect Recognition for a Robotic Game Companion Ksii Transactions on Internet and Information Systems. ,vol. 4, pp. 10- ,(2014) , 10.1145/2622615
Ligang Zhang, Dian Tjondronegoro, Vinod Chandran, Jana Eggink, Towards robust automatic affective classification of images using facial expressions for practical applications Multimedia Tools and Applications. ,vol. 75, pp. 4669- 4695 ,(2016) , 10.1007/S11042-015-2497-5
Hal Daume Iii, Frustratingly Easy Domain Adaptation meeting of the association for computational linguistics. pp. 256- 263 ,(2007)
Chi-Chun Lee, Emily Mower, Carlos Busso, Sungbok Lee, Shrikanth Narayanan, Emotion recognition using a hierarchical binary decision tree approach Speech Communication. ,vol. 53, pp. 1162- 1171 ,(2011) , 10.1016/J.SPECOM.2011.06.004
Natasha Jaques, Sara Taylor, Asaph Azaria, Asma Ghandeharioun, Akane Sano, Rosalind Picard, Predicting students' happiness from physiology, phone, mobility, and behavioral data affective computing and intelligent interaction. ,vol. 2015, pp. 222- 228 ,(2015) , 10.1109/ACII.2015.7344575
Wen-Sheng Chu, Fernando De la Torre, Jeffrey F. Cohn, Selective Transfer Machine for Personalized Facial Expression Analysis IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 39, pp. 529- 545 ,(2017) , 10.1109/TPAMI.2016.2547397
Daniel McDuff, Abdelrahman Mahmoud, Mohammad Mavadati, May Amr, Jay Turcot, Rana el Kaliouby, AFFDEX SDK: A Cross-Platform Real-Time Multi-Face Expression Recognition Toolkit human factors in computing systems. pp. 3723- 3726 ,(2016) , 10.1145/2851581.2890247
Cynthia Breazeal, Samuel Spaulding, Goren Gordon, Affect-Aware Student Models for Robot Tutors adaptive agents and multi-agents systems. pp. 864- 872 ,(2016) , 10.5555/2936924.2937050
Sooyeon Jeong, Cynthia Lynn Breazeal, Improving Smartphone Users' Affect and Wellbeing with Personalized Positive Psychology Interventions human-agent interaction. pp. 131- 137 ,(2016) , 10.1145/2974804.2974831