Face Sketch–Photo Synthesis and Retrieval Using Sparse Representation

作者: Xinbo Gao , Nannan Wang , Dacheng Tao , Xuelong Li

DOI: 10.1109/TCSVT.2012.2198090

关键词: Computer scienceImage retrievalArtificial intelligenceFeature extractionPattern recognitionSketchComputer visionFace (geometry)Sparse approximationImage (mathematics)Visual WordFacial recognition system

摘要: Sketch-photo synthesis plays an important role in sketch-based face photo retrieval and photo-based sketch systems. In this paper, we propose automatic sketch-photo algorithm based on sparse representation. The proposed method works at patch level is composed of two steps: neighbor selection (SNS) for initial estimate the pseudoimage (pseudosketch or pseudophoto) sparse-representation-based enhancement (SRE) further improving quality synthesized image. SNS can find closely related neighbors adaptively then generate pseudoimage. SRE, a coupled representation model first constructed to learn mapping between patches patches, patch-derivative-based subsequently applied enhance photos sketches. Finally, four modes, namely, sketch-based, photo-based, pseudosketch-based, pseudophoto-based are proposed, developed by using Extensive experimental results illustrate effectiveness algorithms.

参考文章(50)
Jianzhuang Liu, Xiaoou Tang, Wei Liu, Bayesian tensor inference for sketch-based facial photo hallucination international joint conference on artificial intelligence. pp. 2141- 2146 ,(2007)
Ángel Serrano, Isaac Martín de Diego, Cristina Conde, Enrique Cabello, Linlin Shen, Li Bai, Influence of Wavelet Frequency and Orientation in an SVM-Based Parallel Gabor PCA Face Verification System Intelligent Data Engineering and Automated Learning - IDEAL 2007. pp. 219- 228 ,(2007) , 10.1007/978-3-540-77226-2_23
J. Matas, K. Messer, J. Kittler, Gilbert Maître, Juergen Luettin, XM2VTSDB: The Extended M2VTS Database Proc. Second International Conference on Audio- and Video-based Biometric Person Authentication (AVBPA'99). ,(1999)
Meng Yang, Lei Zhang, None, Gabor Feature Based Sparse Representation for Face Recognition with Gabor Occlusion Dictionary Computer Vision – ECCV 2010. pp. 448- 461 ,(2010) , 10.1007/978-3-642-15567-3_33
Jin Wang, Hujun Bao, Weihua Zhou, Qunsheng Peng, Xu Yingqing, Automatic image-based pencil sketch rendering Journal of Computer Science and Technology. ,vol. 17, pp. 347- 355 ,(2002) , 10.1007/BF02947313
M. Tominaga, S. Fukuoka, K. Murakami, H. Koshimizu, Facial caricaturing with motion caricaturing in PICASSO system international conference on advanced intelligent mechatronics. pp. 30- ,(1997) , 10.1109/AIM.1997.652888
Xinbo Gao, Juanjuan Zhong, Dacheng Tao, Xuelong Li, Local face sketch synthesis learning Neurocomputing. ,vol. 71, pp. 1921- 1930 ,(2008) , 10.1016/J.NEUCOM.2007.10.025
Juanjuan Zhong, Xinbo Gao, Chunna Tian, Face Sketch Synthesis using E-HMM and Selective Ensemble international conference on acoustics, speech, and signal processing. ,vol. 1, pp. 485- 488 ,(2007) , 10.1109/ICASSP.2007.366722
Bing Xiao, Xinbo Gao, Dacheng Tao, Yuan Yuan, Jie Li, Photo-sketch synthesis and recognition based on subspace learning Neurocomputing. ,vol. 73, pp. 840- 852 ,(2010) , 10.1016/J.NEUCOM.2009.10.014
W. Zhao, R. Chellappa, P. J. Phillips, A. Rosenfeld, Face recognition: A literature survey ACM Computing Surveys. ,vol. 35, pp. 399- 458 ,(2003) , 10.1145/954339.954342