Social event detection using multimodal clustering and integrating supervisory signals

作者: Georgios Petkos , Symeon Papadopoulos , Yiannis Kompatsiaris

DOI: 10.1145/2324796.2324825

关键词:

摘要: A large variety of features can be extracted from raw multimedia items. Moreover, in many contexts, like the case uploaded by users social media platforms, items may linked to metadata that very useful for a analysis tasks. Nevertheless, such are typically heterogeneous and difficult combine unified representation would suitable analysis. In this paper, we discuss problem clustering collections with purpose detecting events. order achieve this, novel multimodal algorithm is proposed. The proposed method uses known currently examined domain, supervise fusion procedure. It tested on MediaEval event detection challenge data compared spectral approach early fusion. By taking advantage explicit supervisory signal, it achieves superior accuracy additionally requires specification much smaller number parameters. has wider scope; not only applicable task detection, but other problems as well.

参考文章(22)
Jianshu Weng, Bu-Sung Lee, None, Event Detection in Twitter international conference on weblogs and social media. ,(2011)
Hassan Sayyadi, Alexey Maykov, Matthew Hurst, Event Detection and Tracking in Social Streams international conference on weblogs and social media. ,(2009)
Xueliang Liu, Benoit Huet, Raphaël Troncy, None, EURECOM @ MediaEval 2011 social event detection task MediaEval. ,(2011)
Cees G. M. Snoek, Marcel Worring, Arnold W. M. Smeulders, Early versus late fusion in semantic video analysis Proceedings of the 13th annual ACM international conference on Multimedia - MULTIMEDIA '05. pp. 399- 402 ,(2005) , 10.1145/1101149.1101236
Vasil Khalidov, Florence Forbes, Radu Horaud, Conjugate mixture models for clustering multimodal data Neural Computation. ,vol. 23, pp. 517- 557 ,(2011) , 10.1162/NECO_A_00074
Symeon Papadopoulos, Emmanouil Schinas, Vasileios Mezaris, Raphaël Troncy, Ioannis Kompatsiaris, The 2012 social event detection dataset acm sigmm conference on multimedia systems. pp. 102- 107 ,(2013) , 10.1145/2483977.2483989
David Arthur, Sergei Vassilvitskii, k-means++: the advantages of careful seeding symposium on discrete algorithms. pp. 1027- 1035 ,(2007) , 10.5555/1283383.1283494
Hans-Peter Kriegel, Peer Kröger, Arthur Zimek, Clustering high-dimensional data ACM Transactions on Knowledge Discovery from Data. ,vol. 3, pp. 1- 58 ,(2009) , 10.1145/1497577.1497578
Xueliang Liu, Raphaël Troncy, Benoit Huet, Finding media illustrating events international conference on multimedia retrieval. pp. 58- ,(2011) , 10.1145/1991996.1992054
S Papadopoulos, C Zigkolis, Y Kompatsiaris, A Vakali, Cluster-Based Landmark and Event Detection for Tagged Photo Collections IEEE MultiMedia. ,vol. 18, pp. 52- 63 ,(2011) , 10.1109/MMUL.2010.68