Image Splicing Tamper Detection Based on Deep Learning and Attention Mechanism

• Published in: 2021 IEEE 6th International Conference on Signal and Image Processing (ICSIP) pp. 267 - 271
• Main Authors: Wang, Chengxiang, Li, Yan, Wu, Guangli
• Format: Conference Proceeding
• Language: English
• Published: IEEE 22.10.2021
• Subjects: Attention mechanism; Classification algorithms; CNN; Convolution; Deep learning; Feature extraction; Heating systems; Prediction algorithms; Splicing; Splicing tamper detection
• DOI: 10.1109/ICSIP52628.2021.9688869

Aiming at the low detection accuracy and poor positioning effect of traditional image Splicing tampering detection methods, an image Splicing tampering detection method based on deep learning and attention mechanism was proposed. Firstly, by convolution neural network (CNN) to extract the image features, the features extracted from CNN were input into the channel attention mechanism module to generate attention characteristic figure; Then, the convolution of 1*1 is used to replace the original full connection layer in the classification, realizing tampering image classification. Finally, the method of adversarial complementary learning (ACOL) is used to automatically locate the tamper area of semantic interest, which is mapped to the original image in the form of heat map to locate the tampering area. The experimental results show that, on CASIA1.0 and CASIA2.0 data sets, the algorithm proposed in this paper can effectively improve the accuracy of Mosaic image tamper detection and locate the tamper area. As for Accuracy, the model in this paper is superior to the existing image Mosaic tamper detection algorithm, and the prediction Accuracy of the two data sets reaches 99.60% and 99.92% respectively.