Tsallis entropy-based information measures for shot boundary detection and keyframe selection

作者: Màrius Vila , Anton Bardera , Qing Xu , Miquel Feixas , Mateu Sbert

DOI: 10.1007/S11760-013-0452-3

关键词:

摘要: Automatic shot boundary detection and keyframe selection constitute major goals in video processing. We propose two different information-theoretic approaches to detect the abrupt boundaries of a sequence. These are, respectively, based on information measures, Tsallis mutual Jensen–Tsallis divergence, that are used quantify similarity between frames. Both measures also find out most representative each shot. The representativeness frame is basically given by its average with respect other frames Several experiments analyze behavior proposed for color spaces (RGB, HSV, Lab), regular binnings, entropic indices. In particular, HSV Lab only 8 bins component an index 1.5 1.8 substantially improve performance previously methods Jensen–Shannon divergence.

参考文章(43)
Jeanine Kelly Stefanucci, Sarah Creem-Regehr, Roland Fleming, William Thompson, Visual Perception from a Computer Graphics Perspective ,(2020)
Giovanni Tardini, Costantino Grana, Rossano Marchi, Rita Cucchiara, Shot detection and motion analysis for automatic MPEG-7 annotation of sports videos international conference on image analysis and processing. pp. 653- 660 ,(2005) , 10.1007/11553595_80
Noel Murphy, Seán Marlow, Noel E. O'Connor, Paul Browne, Alan F. Smeaton, Catherine Berrut, Evaluating and combining digital video shot boundary detection algorithms ,(2000)
Yuzuru Tanaka, Akio Nagasaka, Automatic Video Indexing and Full-Video Search for Object Appearances Proceedings of the IFIP TC2/WG 2.6 Second Working Conference on Visual Database Systems II. pp. 113- 127 ,(1991)
T. Butz, J.-P. Thiran, Shot boundary detection with mutual information international conference on image processing. ,vol. 3, pp. 422- 425 ,(2001) , 10.1109/ICIP.2001.958141
W. Wolf, Key frame selection by motion analysis international conference on acoustics speech and signal processing. ,vol. 2, pp. 1228- 1231 ,(1996) , 10.1109/ICASSP.1996.543588
Andrew P. Abercrombie, Mark S. Tomassi, Real-time image processor ,(1994)
jiang peng, qin xiaolin, Keyframe-Based Video Summary Using Visual Attention Clues IEEE MultiMedia. ,vol. 17, pp. 64- 73 ,(2010) , 10.1109/MMUL.2009.65
André F. T. Martins, Mário A. T. Figueiredo, Pedro M. Q. Aguiar, Noah A. Smith, Eric P. Xing, Nonextensive entropic kernels Proceedings of the 25th international conference on Machine learning - ICML '08. pp. 640- 647 ,(2008) , 10.1145/1390156.1390237