Event-Driven Video Abstraction and Visualization

作者: Jeho Nam , Ahmed H. Tewfik

DOI: 10.1023/A:1013241718521

关键词: Video trackingComputer scienceNatural language processingScheme (programming language)Abstraction (linguistics)Key (cryptography)VisualizationSmacker videoArtificial intelligenceAutomatic summarizationComputer visionEvent (computing)

摘要: In this paper, we propose a new video summarization procedure that produces dynamic (video) abstract of the original sequence. Our technique compactly summarizes data by preserving its temporal characteristics (visual activity) and semantically essential information. It relies on an adaptive nonlinear sampling. The local sampling rate is directly proportional to amount visual activity in localized sub-shot units video. To get very short, yet meaningful summaries, also present event-oriented abstraction scheme, which two semantic eventss emotional dialogue violent action, are characterized abstracted into summary before all other events. If length permits, non key events then added. resulting highly compact.

参考文章(31)
David Bordwell, Kristin Thompson, Film Art: An Introduction ,(1979)
John G. Proakis, John R. Deller, John H. Hansen, Discrete-Time Processing of Speech Signals ,(1993)
Bruce F. Kawin, How movies work ,(1987)
Lawrence Rabiner, Biing-Hwang Juang, Fundamentals of speech recognition ,(1993)
W. Wolf, Key frame selection by motion analysis international conference on acoustics speech and signal processing. ,vol. 2, pp. 1228- 1231 ,(1996) , 10.1109/ICASSP.1996.543588
M.A. Smith, T. Kanade, Video skimming and characterization through the combination of image and language understanding techniques computer vision and pattern recognition. pp. 775- 781 ,(1997) , 10.1109/CVPR.1997.609414
Iain R. Murray, John L. Arnott, Toward the simulation of emotion in synthetic speech: A review of the literature on human vocal emotion Journal of the Acoustical Society of America. ,vol. 93, pp. 1097- 1108 ,(1993) , 10.1121/1.405558
D. Sinha, A.H. Tewfik, Low bit rate transparent audio compression using adapted wavelets IEEE Transactions on Signal Processing. ,vol. 41, pp. 3463- 3479 ,(1993) , 10.1109/78.258086
Y. Tonomura, A. Akutsu, Y. Taniguchi, G. Suzuki, Structured Video Computing IEEE Multimedia. ,vol. 1, pp. 34- 349 ,(1994) , 10.1109/MMUL.1994.318984
Daniel DeMenthon, Vikrant Kobla, David Doermann, Video summarization by curve simplification acm multimedia. pp. 211- 218 ,(1998) , 10.1145/290747.290773