Inference of personality traits and affect schedule by analysis of spontaneous reactions to affective videos

作者: Mojtaba Khomami Abadi , Juan Abdon Miranda Correa , Julia Wache , Heng Yang , Ioannis Patras

DOI: 10.1109/FG.2015.7163100

关键词: Artificial intelligenceBig Five personality traitsCorrelationCognitive psychologyModality (human–computer interaction)Computer visionAgreeablenessInferenceLinear regressionElectroencephalographyPsychologyAffect (psychology)

摘要: This paper presents a method for inferring the Positive and Negative Affect Schedule (PANAS) BigFive personality traits of 35 participants through analysis their implicit responses to 16 emotional videos. The employed modalities record are (i) EEG, (ii) peripheral physiological signals (ECG, GSR), (iii) facial landmark trajectories. predictions traits/PANAS done using linear regression models that trained independently on each modality. main findings this study that: PANAS individuals can be predicted based users' affective video content, ECG+GSR yield 70%±8% F1-score distinction between extroverts/introverts, EEG 69%±6% creative/non creative people, finally (iv) prediction agreeableness, stability, baseline states we achieved significantly higher than chance-level results.

参考文章(31)
M Perugini, L Di Blas, The Big Five Marker Scales (BFMS) and the Italian AB5C taxonomy: Analyses from an emic-etic perspective Hogrefe & Huber Publishers. pp. 281- 304 ,(2002)
Sanaul Haq, Philip JB Jackson, MULTIMODAL EMOTION RECOGNITION Handbook of Pattern Recognition and Computer Vision. pp. 387- 410 ,(2005) , 10.1142/9789812775320_0021
Sander Koelstra, Christian Mühl, Mohammad Soleymani, Jong-Seok Lee, Ashkan Yazdani, Touradj Ebrahimi, Thierry Pun, Anton Nijholt, Ioannis Patras, DEAP: A Database for Emotion Analysis ;Using Physiological Signals IEEE Transactions on Affective Computing. ,vol. 3, pp. 18- 31 ,(2012) , 10.1109/T-AFFC.2011.15
Paul Ekman, Wallace V. Friesen, Constants across cultures in the face and emotion. Journal of Personality and Social Psychology. ,vol. 17, pp. 124- 129 ,(1971) , 10.1037/H0030377
Heng Yang, Changqing Zou, Ioannis Patras, Face Sketch Landmarks Localization in the Wild IEEE Signal Processing Letters. ,vol. 21, pp. 1321- 1325 ,(2014) , 10.1109/LSP.2014.2333544
Con Stough, Catherine Donaldson, Belinda Scarlata, Joseph Ciorciari, Psychophysiological correlates of the NEO PI-R Openness, Agreeableness and Conscientiousness: preliminary results International Journal of Psychophysiology. ,vol. 41, pp. 87- 91 ,(2001) , 10.1016/S0167-8760(00)00176-8
Ruchir Srivastava, Jiashi Feng, Sujoy Roy, Shuicheng Yan, Terence Sim, Don't ask me what i'm like, just watch and listen Proceedings of the 20th ACM international conference on Multimedia - MM '12. pp. 329- 338 ,(2012) , 10.1145/2393347.2393397
Hideo Joho, Jacopo Staiano, Nicu Sebe, Joemon M. Jose, Looking at the viewer: analysing facial activity to detect personal highlights of multimedia contents Multimedia Tools and Applications. ,vol. 51, pp. 505- 523 ,(2011) , 10.1007/S11042-010-0632-X