Deep learning for detection of object-based forgery in advanced video

Ye Yao, Yunqing Shi, Shaowei Weng, Bo Guan

Research output: Contribution to journalArticlepeer-review

61 Scopus citations


Passive video forensics has drawn much attention in recent years. However, research on detection of object-based forgery, especially for forged video encoded with advanced codec frameworks, is still a great challenge. In this paper, we propose a deep learning-based approach to detect object-based forgery in the advanced video. The presented deep learning approach utilizes a convolutional neural network (CNN) to automatically extract high-dimension features from the input image patches. Different from the traditional CNN models used in computer vision domain, we let video frames go through three preprocessing layers before being fed into our CNNmodel. They include a frame absolute difference layer to cut down temporal redundancy between video frames, a max pooling layer to reduce computational complexity of image convolution, and a high-pass filter layer to enhance the residual signal left by video forgery. In addition, an asymmetric data augmentation strategy has been established to get a similar number of positive and negative image patches before the training. The experiments have demonstrated that the proposed CNN-based model with the preprocessing layers has achieved excellent results.

Original languageEnglish (US)
Article number3
Issue number1
StatePublished - Jan 1 2018

All Science Journal Classification (ASJC) codes

  • Computer Science (miscellaneous)
  • Chemistry (miscellaneous)
  • General Mathematics
  • Physics and Astronomy (miscellaneous)


  • Convolutional neural network
  • Deep learning approach
  • Forgery detection and temporal localization
  • Video object forgery detection


Dive into the research topics of 'Deep learning for detection of object-based forgery in advanced video'. Together they form a unique fingerprint.

Cite this