Bridging the gap: effect of text query reformulation in multimodal retrieval

作者: Deepanwita Datta , Sanjay K Singh , C Ravindranath Chowdary , None

DOI: 10.1007/S11042-016-4262-9

关键词:

摘要: Multimodal Retrieval provides new paradigms and methods aimed at effectively searching through the enormous volume of data. retrieval is a well studied problem often used in image retrieval. Most existing works under pretext multimodality stress on bridging semantic gap by using both textual visual features. In this paper, we use relevance feedback from user-generated documents associated with images for expanding query study its effect text We employ topic decomposition based keyphrase extraction technique to expand queries. Our results articulate fact that an insightful expansion always improves performance or Also, adopt optimum weight learning scheme combine modalities privileged way. perform comparative two established techniques which are expansion. A detailed set experiments standard real world dataset also carried out same.

参考文章(32)
Adrien Depeursinge, Henning Müller, Fusion Techniques for Combining Textual and Visual Information Retrieval ImageCLEF. pp. 95- 114 ,(2010) , 10.1007/978-3-642-15181-1_6
Hinrich Schütze, Christopher D. Manning, Prabhakar Raghavan, Introduction to Information Retrieval ,(2005)
Débora Myoupo, Adrian Popescu, Hervé Le Borgne, Pierre-Alain Moëllic, Multimodal Image Retrieval over a Large Database Lecture Notes in Computer Science. pp. 177- 184 ,(2010) , 10.1007/978-3-642-15751-6_20
Alberto Del Bimbo, Visual Information Retrieval ,(1999)
Christophe Moulin, Christine Largeron, Christophe Ducottet, Mathias Géry, Cécile Barat, Fisher Linear Discriminant Analysis for text-image combination in multimedia information retrieval Pattern Recognition. ,vol. 47, pp. 260- 269 ,(2014) , 10.1016/J.PATCOG.2013.06.003
Claudio Carpineto, Giovanni Romano, A Survey of Automatic Query Expansion in Information Retrieval ACM Computing Surveys. ,vol. 44, pp. 1- 50 ,(2012) , 10.1145/2071389.2071390
Mandar Mitra, Amit Singhal, Chris Buckley, Improving automatic query expansion international acm sigir conference on research and development in information retrieval. pp. 206- 214 ,(1998) , 10.1145/290941.290995
Xiang Sean Zhou, T.S. Huang, Unifying keywords and visual contents in image retrieval IEEE MultiMedia. ,vol. 9, pp. 23- 33 ,(2002) , 10.1109/93.998050
Magali Joint, Pierre-Alain Moellic, P. Hede, P. Adam, PIRIA: a general tool for indexing, search, and retrieval of multimedia content electronic imaging. ,vol. 5298, pp. 116- 125 ,(2004) , 10.1117/12.525631