Cross-Modal Saliency Correlation for Image Annotation

作者: Yun Gu , Haoyang Xue , Jie Yang

DOI: 10.1007/S11063-016-9511-4

关键词:

摘要: Automatic image annotation is an attractive service for users and administrators of online photo sharing websites. In this paper, we propose approach exploiting the crossmodal saliency correlation including visual textual saliency. For saliency, a concept graph firstly established based on association between labels. Then semantic communities latent are detected; adopt dual-layer BoW (DL-BoW) model integrated with local features salient regions image. Experiments MIRFlickr IAPR TC-12 datasets demonstrate that proposed method outperforms other state-of-the-art approaches.

参考文章(36)
M. Grubinger, The IAPR Benchmark : A New Evaluation Resource for Visual Information Systems language resources and evaluation. ,(2006)
Yun Gu, Haoyang Xue, Jie Yang, Zhenhong Jia, None, Automatic Image Annotation Exploiting Textual and Visual Saliency Neural Information Processing. pp. 95- 102 ,(2014) , 10.1007/978-3-319-12643-2_12
Jianlong Fu, Tao Mei, Kuiyuan Yang, Hanqing Lu, Yong Rui, Tagging Personal Photos with Transfer Deep Learning the web conference. pp. 344- 354 ,(2015) , 10.1145/2736277.2741112
Xiaochun Cao, Changqing Zhang, Chengju Zhou, Huazhu Fu, Hassan Foroosh, Constrained Multi-View Video Face Clustering IEEE Transactions on Image Processing. ,vol. 24, pp. 4381- 4393 ,(2015) , 10.1109/TIP.2015.2463223
Xi Liu, Rujie Liu, Fei Li, Qiong Cao, Graph-based dimensionality reduction for KNN-based image annotation international conference on pattern recognition. pp. 1253- 1256 ,(2012)
Yun Gu, Xueming Qian, Qing Li, Meng Wang, Richang Hong, Qi Tian, Image Annotation by Latent Community Detection and Multikernel Learning IEEE Transactions on Image Processing. ,vol. 24, pp. 3450- 3463 ,(2015) , 10.1109/TIP.2015.2443501
Zhigang Ma, Feiping Nie, Yi Yang, Jasper R. R. Uijlings, Nicu Sebe, Web Image Annotation Via Subspace-Sparsity Collaborated Feature Selection IEEE Transactions on Multimedia. ,vol. 14, pp. 1021- 1030 ,(2012) , 10.1109/TMM.2012.2187179
Jinhui Tang, Richang Hong, Shuicheng Yan, Tat-Seng Chua, Guo-Jun Qi, Ramesh Jain, Image annotation by k NN-sparse graph-based label propagation over noisily tagged web images ACM Transactions on Intelligent Systems and Technology. ,vol. 2, pp. 1- 15 ,(2011) , 10.1145/1899412.1899418
Yahong Han, Fei Wu, Qi Tian, Yueting Zhuang, Image Annotation by Input–Output Structural Grouping Sparsity IEEE Transactions on Image Processing. ,vol. 21, pp. 3066- 3079 ,(2012) , 10.1109/TIP.2012.2183880
Ameesh Makadia, Vladimir Pavlovic, Sanjiv Kumar, Baselines for Image Annotation International Journal of Computer Vision. ,vol. 90, pp. 88- 105 ,(2010) , 10.1007/S11263-010-0338-6