FaceForensics++: Learning to Detect Manipulated Facial Images

作者: Christian Riess , Luisa Verdoliva , Matthias Nießner , Justus Thies , Davide Cozzolino

DOI:

关键词:

摘要: The rapid progress in synthetic image generation and manipulation has now come to a point where it raises significant concerns for the implications towards society. At best, this leads loss of trust digital content, but could potentially cause further harm by spreading false information or fake news. This paper examines realism state-of-the-art manipulations, how difficult is detect them, either automatically humans. To standardize evaluation detection methods, we propose an automated benchmark facial detection. In particular, based on DeepFakes, Face2Face, FaceSwap NeuralTextures as prominent representatives manipulations at random compression level size. publicly available contains hidden test set well database over 1.8 million manipulated images. dataset order magnitude larger than comparable, available, forgery datasets. Based data, performed thorough analysis data-driven detectors. We show that use additional domainspecific knowledge improves unprecedented accuracy, even presence strong compression, clearly outperforms human observers.

参考文章(67)
Diederik P. Kingma, Jimmy Ba, Adam: A Method for Stochastic Optimization arXiv: Learning. ,(2014)
V. Conotter, E. Bodnari, G. Boato, H. Farid, Physiologically-based detection of computer generated faces in video 2014 IEEE International Conference on Image Processing (ICIP). pp. 248- 252 ,(2014) , 10.1109/ICIP.2014.7025049
Tiago José De Carvalho, Christian Riess, Elli Angelopoulou, Helio Pedrini, Anderson de Rezende Rocha, None, Exposing Digital Image Forgeries by Illumination Color Classification IEEE Transactions on Information Forensics and Security. ,vol. 8, pp. 1182- 1194 ,(2013) , 10.1109/TIFS.2013.2265677
Kevin Dale, Kalyan Sunkavalli, Micah K. Johnson, Daniel Vlasic, Wojciech Matusik, Hanspeter Pfister, Video face replacement Proceedings of the 2011 SIGGRAPH Asia Conference on - SA '11. ,vol. 30, pp. 130- ,(2011) , 10.1145/2024156.2024164
Justus Thies, Michael Zollhöfer, Matthias Nießner, Levi Valgaerts, Marc Stamminger, Christian Theobalt, Real-time expression transfer for facial reenactment international conference on computer graphics and interactive techniques. ,vol. 34, pp. 183- ,(2015) , 10.1145/2816795.2818056
Jessica Fridrich, Jan Kodovsky, Rich Models for Steganalysis of Digital Images IEEE Transactions on Information Forensics and Security. ,vol. 7, pp. 868- 882 ,(2012) , 10.1109/TIFS.2012.2190402
Paolo Bestagini, Simone Milani, Marco Tagliasacchi, Stefano Tubaro, Local tampering detection in video sequences multimedia signal processing. pp. 488- 493 ,(2013) , 10.1109/MMSP.2013.6659337
Davide Cozzolino, Diego Gragnaniello, Luisa Verdoliva, Image forgery detection through residual-based local descriptors and block-matching 2014 IEEE International Conference on Image Processing (ICIP). pp. 5297- 5301 ,(2014) , 10.1109/ICIP.2014.7026072
Patrick Pérez, Michel Gangnet, Andrew Blake, Poisson image editing international conference on computer graphics and interactive techniques. ,vol. 22, pp. 313- 318 ,(2003) , 10.1145/1201775.882269