MediaBrain: Annotating Videos based on Brain-Computer Interaction

作者: Florian Pfleiderer , Alireza Sahami Shirazi , Hendrik Glück , Markus Funk , Albrecht Schmidt

DOI:

关键词:

摘要: Adding notes to time segments on a video timeline makes it easier search, find, and playback important of the video. Various approaches have been explored annotate videos (semi) automatically summarize videos. In this research we investigate feasibility implicitly annotating based brain signals retrieved from Brain-Computer Interface (BCI) headset. The provided by BCI can reveal different information such as activities, facial expressions, or level users’ excitement. This correlates with scenes users watch in Thus, be used for generating summary. To achieve goal, an annotation tool called MediaBrain is developed user study conducted. result reveals that possible select set highlights excitement information.

参考文章(21)
Jack Mostow, Kai-min Chang, Jessica Nelson, Udip Pant, Toward exploiting EEG input in a reading tutor artificial intelligence in education. ,vol. 22, pp. 230- 237 ,(2011) , 10.3233/JAI-130033
Genaro Rebolledo-Mendez, Ian Dunwell, Erika A. Martínez-Mirón, María Dolores Vargas-Cerdán, Sara de Freitas, Fotis Liarokapis, Alma R. García-Gaona, Assessing NeuroSky's Usability to Detect Attention Levels in an Assessment Exercise international conference on human computer interaction. pp. 149- 158 ,(2009) , 10.1007/978-3-642-02574-7_17
Satoshi Nakamura, Makoto Shimizu, Katsumi Tanaka, Can social annotation support users in evaluating the trustworthiness of video clips? Proceeding of the 2nd ACM workshop on Information credibility on the web - WICOW '08. pp. 59- 62 ,(2008) , 10.1145/1458527.1458542
Katie Crowley, Aidan Sliney, Ian Pitt, Dave Murphy, Evaluating a Brain-Computer Interface to Categorise Human Emotional Response international conference on advanced learning technologies. pp. 276- 278 ,(2010) , 10.1109/ICALT.2010.81
S. Kanoh, K. Miyamoto, T. Yoshinobu, A P300-based BCI system for controlling computer cursor movement international conference of the ieee engineering in medicine and biology society. ,vol. 2011, pp. 6405- 6408 ,(2011) , 10.1109/IEMBS.2011.6091581
Katashi Nagao, Shigeki Ohira, Mitsuhiro Yoneoka, Annotation-based multimedia summarization and translation Proceedings of the 19th international conference on Computational linguistics -. pp. 1- 7 ,(2002) , 10.3115/1072228.1072326
Myeung-Sook Yoh, Joonho Kwon, Sunghoon Kim, NeuroWander Proceedings of the 12th ACM international conference adjunct papers on Ubiquitous computing - Ubicomp '10. pp. 389- 390 ,(2010) , 10.1145/1864431.1864450
Albrecht Schmidt, Implicit human computer interaction through context Personal and Ubiquitous Computing. ,vol. 4, pp. 191- 199 ,(2000) , 10.1007/BF01324126
Georg Buscher, Andreas Dengel, Ludger van Elst, Query expansion using gaze-based feedback on the subdocument level Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '08. pp. 387- 394 ,(2008) , 10.1145/1390334.1390401
Alireza Sahami Shirazi, Michael Rohs, Robert Schleicher, Sven Kratz, Alexander Müller, Albrecht Schmidt, Real-time nonverbal opinion sharing through mobile phones during sports events human factors in computing systems. pp. 307- 310 ,(2011) , 10.1145/1978942.1978985