Handling imperfections for multimodal image annotation

作者: Amel Znaidia

DOI:

关键词: ModalitiesImage retrievalAnnotationComputer scienceData miningImage (mathematics)Context (language use)Artificial intelligenceNatural language processingRepresentation (mathematics)Focus (optics)Automatic image annotation

摘要: This thesis deals with multimodal image annotation in the context of social media. We seek to take advantage textual (tags) and visual information order enhance performances. However, these tags are often noisy, overly personalized only a few them related semantic content image. In addition, when combining prediction scores from different classifiers learned on modalities, faces their imperfections (uncertainty, imprecision incompleteness). Consequently, we consider that is subject at two levels: representation decision. Inspired fusion theory, focus this defining, identifying handling imperfection aspects improve annotation.

参考文章(149)
Paul Clough, Henning Müller, Mark Sanderson, Seven Years of Image Retrieval Evaluation ImageCLEF. pp. 3- 18 ,(2010) , 10.1007/978-3-642-15181-1_1
Wojciech Samek, Alexander Binder, Marius Kloft, Motoaki Kawanabe, The joint submission of the TU Berlin and Fraunhofer FIRST (TUBFI) to the ImageCLEF2011 Photo Annotation Task 2011 Working Notes for CLEF Conference, CLEF 2011. ,(2011)
Dirk Geeraerts, Yves Peirsman, Dirk Speelman, Kris Heylen, Modelling word similarity: an evaluation of automatic synonymy extraction algorithms language resources and evaluation. pp. 3243- 3249 ,(2008)
Michael Strube, Simone Paolo Ponzetto, WikiRelate! computing semantic relatedness using wikipedia national conference on artificial intelligence. pp. 1419- 1424 ,(2006)
Stéphane Marchand-Maillet, Donn Morrison, Enikö Szekely, Eric Bruno, Interactive Representations of Multimodal Databases Multimodal Signal Processing#R##N#Theory and Applications for Human–Computer Interaction. pp. 279- 307 ,(2010) , 10.1016/B978-0-12-374825-6.00006-X
Jinming Min, Wei B. Li, Gareth J.F. Jones, A text-based approach to the ImageCLEF 2010 photo annotation task CLEF (Notebook Papers/LABs/Workshops). ,(2010)
Didier Dubois, Henri Prade, Philippe Smets, New Semantics for Quantitative Possibility Theory european conference on symbolic and quantitative approaches to reasoning and uncertainty. ,vol. 2143, pp. 410- 421 ,(2001) , 10.1007/3-540-44652-4_36
Dimitri Semenovich, Arcot Sowmya, Geometry aware local kernels for object recognition asian conference on computer vision. pp. 490- 503 ,(2010) , 10.1007/978-3-642-19315-6_38
Philippe Smets, Practical uses of belief functions uncertainty in artificial intelligence. pp. 612- 621 ,(1999)
Aude Oliva, Antonio Torralba, Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope International Journal of Computer Vision. ,vol. 42, pp. 145- 175 ,(2001) , 10.1023/A:1011139631724