ROSbag-based Multimodal Affective Dataset for Emotional and Cognitive States

作者: Wonse Jo , Shyam Sundar Kannan , Go-Eum Cha , Ahreum Lee , Byung-Cheol Min

DOI: 10.1109/SMC42975.2020.9283320

关键词:

摘要: This paper introduces a new ROSbag-based multimodal affective dataset for emotional and cognitive states generated using the Robot Operating System (ROS). We utilized images sounds from International Affective Pictures (IAPS) Digitized Sounds (IADS) to stimulate targeted emotions (happiness, sadness, anger, fear, surprise, disgust, neutral), dual N-back game different levels of workload. 30 human subjects participated in user study; their physiological data were collected latest commercial wearable sensors, behavioral hardware devices such as cameras, subjective assessments carried out through questionnaires. All stored single ROSbag files rather than conventional Comma-Separated Values (CSV) files. not only ensures synchronization signals videos set, but also allows researchers easily analyze verify algorithms by connecting directly this ROS. The consists 1,602 files, size is about 787GB. made publicly available. expect that our can be great resource many fields computing, Human-Computer Interaction (HCI), Human-Robot (HRI).

参考文章(23)
Peter J Lang, Margaret M Bradley, Bruce N Cuthbert, International affective picture system (IAPS) : affective ratings of pictures and instruction manual CTIT technical reports series. ,(2005)
Ali Mollahosseini, Behzad Hasani, Mohammad H. Mahoor, AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wild IEEE Transactions on Affective Computing. ,vol. 10, pp. 18- 31 ,(2019) , 10.1109/TAFFC.2017.2740923
Peter J Lang, Margaret M Bradley, Bruce N Cuthbert, International Affective Picture System (IAPS) : Technical Manual and Affective Ratings The Center for Research in Psychophysiology, University of Florida. ,(1995)
Sander Koelstra, Christian Mühl, Mohammad Soleymani, Jong-Seok Lee, Ashkan Yazdani, Touradj Ebrahimi, Thierry Pun, Anton Nijholt, Ioannis Patras, DEAP: A Database for Emotion Analysis ;Using Physiological Signals IEEE Transactions on Affective Computing. ,vol. 3, pp. 18- 31 ,(2012) , 10.1109/T-AFFC.2011.15
Mojtaba Khomami Abadi, Ramanathan Subramanian, Seyed Mostafa Kia, Paolo Avesani, Ioannis Patras, Nicu Sebe, DECAF: MEG-Based Multimodal Database for Decoding Affective Physiological Responses IEEE Transactions on Affective Computing. ,vol. 6, pp. 209- 222 ,(2015) , 10.1109/TAFFC.2015.2392932
M. Hampson, N. R. Driesen, P. Skudlarski, J. C. Gore, R. T. Constable, Brain Connectivity Related to Working Memory Performance The Journal of Neuroscience. ,vol. 26, pp. 13338- 13343 ,(2006) , 10.1523/JNEUROSCI.3408-06.2006
Howard Leventhal, Klaus Scherer, The Relationship of Emotion to Cognition: A Functional Approach to a Semantic Controversy Cognition & Emotion. ,vol. 1, pp. 3- 28 ,(1987) , 10.1080/02699938708408361
Sandra G. Hart, Lowell E. Staveland, Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research Advances in Psychology. ,vol. 52, pp. 139- 183 ,(1988) , 10.1016/S0166-4115(08)62386-9
Margaret M. Bradley, Peter J. Lang, Measuring emotion: The self-assessment manikin and the semantic differential Journal of Behavior Therapy and Experimental Psychiatry. ,vol. 25, pp. 49- 59 ,(1994) , 10.1016/0005-7916(94)90063-9
Olga C. Santos, Emotions and Personality in Adaptive e-Learning Systems: An Affective Computing Perspective Emotions and Personality in Personalized Services. pp. 263- 285 ,(2016) , 10.1007/978-3-319-31413-6_13