Divide-and-conquer based summarization framework for extracting affective video content

作者: Irfan Mehmood , Muhammad Sajjad , Seungmin Rho , Sung Wook Baik

DOI: 10.1016/J.NEUCOM.2015.05.126

关键词:

摘要: Recent advances in multimedia technology have led to tremendous increases the available volume of video data, thereby creating a major requirement for efficient systems manage such huge data volumes. Video summarization is one key techniques accessing and managing large libraries. can be used extract affective contents sequence generate concise representation its content. Human attention models are an means content extraction. Existing visual driven frameworks high computational cost memory requirements, as well lack efficiency accurately perceiving human attention. To cope with these issues, we propose divide-and-conquer based framework big data. We divide original into shots, where model computed from each shot parallel. Viewer's on multiple sensory perceptions, i.e., aural visual, viewer's neuronal signals. The Teager energy, instant amplitude, frequency, whereas employs multi-scale contrast motion intensity. Moreover, using beta-band frequencies Next, aggregated curve generated intra- inter-modality fusion mechanism. Finally, extracted. signals provides bridge that links digital perceptions. Our experimental results indicate proposed shot-detection strategy mitigates time complexity. accurate reflection user preferences facilitates extraction highly personalized summaries.

参考文章(52)
Jérôme Martin, James L. Crowley, Experimental Comparison of Correlation Techniques ,(2007)
Georgios Evangelopoulos, Konstantinos Rapantzikos, Petros Maragos, Yannis Avrithis, Alexandros Potamianos, Audiovisual Attention Modeling and Salient Event Detection Multimodal Processing and Interaction. pp. 1- 21 ,(2008) , 10.1007/978-0-387-76316-3_8
Saeid Sanei, Jonathon Chambers, EEG Signal Processing ,(2007)
jiang peng, qin xiaolin, Keyframe-Based Video Summary Using Visual Attention Clues IEEE MultiMedia. ,vol. 17, pp. 64- 73 ,(2010) , 10.1109/MMUL.2009.65
Jianwei Niu, Da Huo, Kongqiao Wang, Chao Tong, Real-time generation of personalized home video summaries on mobile devices Neurocomputing. ,vol. 120, pp. 404- 414 ,(2013) , 10.1016/J.NEUCOM.2012.06.056
Arthur G. Money, Harry Agius, ELVIS: Entertainment-led video summaries ACM Transactions on Multimedia Computing, Communications, and Applications. ,vol. 6, pp. 17- ,(2010) , 10.1145/1823746.1823751
Naveed Ejaz, Irfan Mehmood, Sung Wook Baik, Efficient visual attention based framework for extracting key frames from videos Signal Processing-image Communication. ,vol. 28, pp. 34- 44 ,(2013) , 10.1016/J.IMAGE.2012.10.002
Naveed Ejaz, Sung Wook Baik, Video summarization using a network of radial basis functions Multimedia Systems. ,vol. 18, pp. 483- 497 ,(2012) , 10.1007/S00530-012-0263-3