Towards fusion of collective knowledge and audio-visual content features for annotating broadcast video

作者: Fréderic Godin , Wesley De Neve , Rik Van de Walle

DOI: 10.1145/2461466.2461530

关键词: Task (project management)MultimediaContent analysisCollective intelligenceInformation retrievalVideo trackingContent (Freudian dream analysis)AnnotationComputer scienceSocial mediaPlan (drawing)

摘要: Broadcasters produce vast collections of video content. However, the lack fine-grained annotations makes it difficult to retrieve fragments interest from these collections. Indeed, manual annotation content is labour-intensive and time-consuming. Moreover, applicability algorithms for automatic limited, given that too many prerequisites need be fulfilled a lot concepts are unidentifiable. At same time, people using social media share their thoughts about they view on television. Therefore, in this Ph.D. research, we plan investigate novel machine learning-based approaches towards task broadcast content, fusing collective knowledge present with output audio-visual analysis algorithms.

参考文章(9)
James Lanagan, Alan F. Smeaton, Using Twitter to Detect and Tag Important Events in Sports Media international conference on weblogs and social media. ,(2011)
Xingtian Shi, Zhenglu Yang, Masashi Toyoda, Masaru Kitsuregawa, Harnessing the wisdom of crowds: video event detection based on synchronous comments the web conference. pp. 123- 124 ,(2011) , 10.1145/1963192.1963255
Lexing Xie, L. Kennedy, Shih-Fu Chang, A. Divakaran, Huifang Sun, Ching-Yung Lin, Layered dynamic mixture model for pattern discovery in asynchronous multi-modal streams [video applications] international conference on acoustics, speech, and signal processing. ,vol. 2, pp. 1053- 1056 ,(2005) , 10.1109/ICASSP.2005.1415589
Pradeep K. Atrey, M. Anwar Hossain, Abdulmotaleb El Saddik, Mohan S. Kankanhalli, Multimodal fusion for multimedia analysis: a survey Multimedia Systems. ,vol. 16, pp. 345- 379 ,(2010) , 10.1007/S00530-010-0182-0
Jun Yang, Alexander G. Hauptmann, (Un)Reliability of video concept detection Proceedings of the 2008 international conference on Content-based image and video retrieval - CIVR '08. pp. 85- 94 ,(2008) , 10.1145/1386352.1386367
Changsheng Xu, Yi-Fan Zhang, Guangyu Zhu, Yong Rui, Hanqing Lu, Qingming Huang, Using Webcast Text for Semantic Event Detection in Broadcast Sports Video IEEE Transactions on Multimedia. ,vol. 10, pp. 1342- 1355 ,(2008) , 10.1109/TMM.2008.2004912
Valentin Robu, Harry Halpin, Hana Shepherd, Emergence of consensus and shared vocabularies in collaborative tagging systems ACM Transactions on The Web. ,vol. 3, pp. 14- ,(2009) , 10.1145/1594173.1594176
John Hannon, Kevin McCarthy, James Lynch, Barry Smyth, Personalized and automatic social summarization of events in video Proceedings of the 15th international conference on Intelligent user interfaces - IUI '11. pp. 335- 338 ,(2011) , 10.1145/1943403.1943459
C.R. Dijkshoorn, M.G.J. van Erp, G. van Oorschot, Automatic Extraction of Soccer Game Events from Twitter international semantic web conference. pp. 21- 30 ,(2012)