Exposing low-quality deepfake videos of Social Network Service using Spatial Restored Detection Framework

Ying Li, Shan Bian, Chuntao Wang, Kemal Polat, Adi Alhudhaif, Fayadh Alenezi

Research output: Contribution to journalArticlepeer-review

18 Scopus citations

Abstract

The increasing abuse of facial manipulation methods, such as FaceSwap, Deepfakes etc., seriously threatens the authenticity of digital images/videos on the Internet. Therefore, it is of great importance to identify the facial videos to confirm the contents and avoid fake news or rumors. Many researchers have paid great attention to the detection of deepfakes and put forward a number of deep-learning-based detection models. The existing approaches mostly face the performance degradation in detecting low-quality(LQ) videos, i.e. heavily compressed or low-resolution videos through some SNS (Social Network Service), resulting in the limitation in real applications. To address this issue, in this paper, a novel Spatial Restore Detection Framework(SRDF) is proposed for improving the detection performance for LQ videos by restoring spatial features. We designed a feature extraction-enhancement block and a mapping block inspired by super-resolution methods, to restore and enhance texture features. An attention module was introduced to guide the texture features restoration and enhancement stage attending to different local areas and restoring the texture features. Besides, an improved isolated loss was put forward to prevent the expansion of a single area concerned. Moreover, we adopted a regional data augmentation strategy to prompt feature restore and enhancement in the region attended. Extensive experiments conducted on two deepfake datasets have validated the superiority of the proposed method compared to the state-of-the-art, especially in the scenarios of detecting low-quality deepfake videos.

Original languageEnglish
Article number120646
JournalExpert Systems with Applications
Volume231
DOIs
StatePublished - 30 Nov 2023

Keywords

  • Attention mechanism
  • Deepfake detection
  • Super resolution
  • Video forensics

Fingerprint

Dive into the research topics of 'Exposing low-quality deepfake videos of Social Network Service using Spatial Restored Detection Framework'. Together they form a unique fingerprint.

Cite this