Adversarially robust deepfake media detection using fused convolutional neural network predictions.

作者: Alessandro Artusi , Hang Dai , Sohail Ahmed Khan

DOI:

关键词:

摘要: Deepfakes are synthetically generated images, videos or audios, which fraudsters use to manipulate legitimate information. Current deepfake detection systems struggle against unseen data. To address this, we employ three different deep Convolutional Neural Network (CNN) models, (1) VGG16, (2) InceptionV3, and (3) XceptionNet classify fake real images extracted from videos. We also constructed a fusion of the CNN models improve robustness generalisation capability. The proposed technique outperforms state-of-the-art with 96.5% accuracy, when tested on publicly available DeepFake Detection Challenge (DFDC) test data, comprising 400 model achieves 99% accuracy lower quality DeepFake-TIMIT dataset 91.88% higher In addition prove that prediction is more robust adversarial attacks. If one compromised by an attack, does not let it affect overall classification.

参考文章(19)
, Generative Adversarial Nets neural information processing systems. ,vol. 27, pp. 2672- 2680 ,(2014) , 10.3156/JSOFT.29.5_177_2
Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jon Shlens, Zbigniew Wojna, Rethinking the Inception Architecture for Computer Vision computer vision and pattern recognition. pp. 2818- 2826 ,(2016) , 10.1109/CVPR.2016.308
Zhifeng Li, Yu Qiao, Kaipeng Zhang, Zhanpeng Zhang, Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networks arXiv: Computer Vision and Pattern Recognition. ,(2016) , 10.1109/LSP.2016.2603342
Francois Chollet, Xception: Deep Learning with Depthwise Separable Convolutions computer vision and pattern recognition. pp. 1800- 1807 ,(2017) , 10.1109/CVPR.2017.195
Darius Afchar, Vincent Nozick, Junichi Yamagishi, Isao Echizen, MesoNet: a Compact Facial Video Forgery Detection Network international workshop on information forensics and security. pp. 1- 7 ,(2018) , 10.1109/WIFS.2018.8630761
Pavel Korshunov, Sébastien Marcel, DeepFakes: a New Threat to Face Recognition? Assessment and Detection arXiv: Computer Vision and Pattern Recognition. ,(2018)
Umur Aybars Ciftci, Ilke Demir, Lijun Yin, FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals IEEE Transactions on Pattern Analysis and Machine Intelligence. pp. 1- 1 ,(2020) , 10.1109/TPAMI.2020.3009287
David Guera, Edward J. Delp, Deepfake Video Detection Using Recurrent Neural Networks advanced video and signal based surveillance. pp. 1- 6 ,(2018) , 10.1109/AVSS.2018.8639163
Ian J Goodfellow, Jonathon Shlens, Christian Szegedy, None, Explaining and Harnessing Adversarial Examples international conference on learning representations. ,(2015)
Huy H. Nguyen, Junichi Yamagishi, Isao Echizen, Capsule-forensics: Using Capsule Networks to Detect Forged Images and Videos ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). pp. 2307- 2311 ,(2019) , 10.1109/ICASSP.2019.8682602