面向图像复制-粘贴溯源的级联双流注意力网络

doi:10.3778/j.issn.1673-9418.2203118

摘要/Abstract

摘要： 复制-粘贴是一种常见的图像篡改方式。传统的图像复制-粘贴取证方法主要致力于伪造区域定位研究，而如何精细化区分复制的源和粘贴的目标区域是图像取证领域的难点问题。当前，能从原始伪造图像中定位篡改源/目标区域的算法普遍存在不足。在已有算法的基础上提出了一种级联双流注意力网络。该网络分为两个阶段：第一阶段由编码、特征分析和解码网络构成。在编码部分，采用轻量级网络MobileNetV2作为主干提取图像浅层和深层特征形成双流输出；在特征分析阶段，利用相似特征注意力机制和空洞空间卷积池化金字塔模块多尺度捕捉深层特征中的篡改区域，并利用浅层特征分支改善网络对篡改区域边缘细节的分割性能；在解码部分，对特征图逐像素做类别预测并上采样。网络的第二阶段对一阶段检测到的篡改区域进行源/目标区分。同样采用双流结构，双分支输入分别为包含源/目标区域的原始图像块和经过提取的噪声图。同时将提取到的块特征融合后预测类别，最终采用区域映射的方式实现像素级定位。实验结果表明，该网络不仅能有效地定位篡改区域，同时还能较好地区分复制-粘贴的源/目标。该网络的第一阶段在测试集和两个公共数据集上相较于同结构模型，性能分别上升9.4、2.6和2.5个百分点，而最终的端到端测试集检测性能提升12.03%；同时，其对常规的图像后处理具有更好的鲁棒性。

关键词: 图像篡改区域定位, 级联双流网络, 特征融合, 注意力机制, 图像噪声提取

Abstract: Copy-move is a common way of the image forgery. Traditional methods are committed to locating tam-pering regions of copy-move tampering images, but the accurate distinction between the source and target of the copy-move image has become a bottleneck in the field of image forensics. At present, algorithms which can locate the tampering source and target regions from the original copy-move forged images still have some disadvantages. Therefore, this paper proposes a cascaded two-stream attention network for traceability analysis of copy-move images. It is divided into two stages. The first stage of the network includes a coding network, a module to analyze features and a decoding network. In the coding part, lightweight MobileNetV2 is used as the backbone to extract low and deep features as the double outputs of the network. In the module of analyzing features, tampering regions in deep features are multi-dimensionally captured by the attention mechanism of similar features and atrous spatial pyramid pooling module. At the same time, the low feature is used to improve the model’s performance of segmenting edges and details of tampered regions. In the decoding part, the feature map is predicted pixel by pixel and sampled. In the second stage of the network, the tampering regions detected in the first stage network are distinguished between the source and target. It is also a two-stream network. The inputs of two-branch are the original image blocks including the source or target and image blocks after extracting noise. The multiscale features are used to predict category, and the final mask is output by the region mapping. Experimental results show that the proposed network can not only locate the tampering regions, but also distinguish the source and target. The performance compared with the latest algorithm of the first stage of the network in the test dataset and two public datasets is increased by 9.4, 2.6, and 2.5 percentage points respectively, and the end-to-end performance in the test dataset is improved by 12.03%. At the same time, it has better robustness to conventional image post-processing.

Key words: localization of tampering regions in images, cascaded two-stream networks, feature fusion, attention module, noise extraction of image

吉彦卿, 张玉金. 面向图像复制-粘贴溯源的级联双流注意力网络[J]. 计算机科学与探索, 2023, 17(8): 1981-1994.

JI Yanqing, ZHANG Yujin. Cascaded Two-Stream Attention Networks for Traceability Analysis of Copy-Move Images[J]. Journal of Frontiers of Computer Science and Technology, 2023, 17(8): 1981-1994.

参考文献

[1] POPESCU A, FARID H. Exposing digital forgeries by detec-ting duplicated image regions[R]. Dartmouth College，2004.
[2] CHRISTLEIN V, RIESS C, JORDAN J, et al. An evalua-tion of popular copy-move forgery detection approaches[J]. IEEE Transactions on Information Forensics and Security, 2012, 7(6): 1841-1854.
[3] COZZOLINO D, POGGI G, VERDOLIVA L. Efficient dense-field copy-move tampering detection[J]. IEEE Transactions on Information Forensics and Security, 2015, 10(11): 2284-2297.
[4] HUANG H, GUO W, ZHANG Y. Detection of copy-move tampering in digital images using SIFT algorithm[C]//Pro-ceedings of the 2008 IEEE Pacific-Asia Workshop on Com-putational Intelligence and Industrial Application, Wuhan, Dec 19-20, 2008. Piscataway: IEEE, 2009: 272-276.
[5] AMERINI I, BALLAN L, CALDELLI R, et al. A SIFT-based forensic method for copy-move attack detection and trans-formation recovery[J]. IEEE Transactions on Information Forensics and Security, 2011, 6(3): 1099-1110.
[6] SILVA E, CARVALHO T, FERREIRA A, et al. Going deeper into copy-move forgery detection: exploring image telltales via multi-scale analysis and voting processes[J]. Journal of Visual Communication and Image Representation, 2015, 29: 16-32.
[7] 肖斌, 景如霞, 毕秀丽, 等. 基于分组SIFT的图像复制粘贴篡改快速检测算法[J]. 通信学报, 2020, 41(3): 62-70.
XIAO B, JING R X, BI X L, et al. Fast copy-move tampe-ring detection algorithm based on group SIFT[J]. Journal on Communications, 2020, 41(3): 62-70.
[8] LOWE D G. Distinctive image features from scale-invariant key-points[J]. International Journal of Computer Vision, 2004, 60(2): 91-110.
[9] BAY H, ESS A, TUYTELAARS T, et al. Speeded-up robust features (SURF)[J]. Computer Vision & Image Understan-ding, 2008, 110(3): 346-359.
[10] LI Y, ZHOU J. Fast and effective image copy-move tampe-ring detection via hierarchical feature point matching[J]. IEEE Transactions on Information Forensics and Security, 2019, 14(5): 1307-1322.
[11] RAO Y, NI J. A deep learning approach to detection of splicing and copy-move forgeries in images[C]//Proceedings of the 2016 IEEE International Workshop on Information Forensics and Security, Abu Dhabi, Dec 4-7, 2016. Piscata-way: IEEE, 2016: 1-6.
[12] OUYANG J, LIU Y, LIAO M. Copy-move tampering detec-tion based on deep learning[C]//Proceedings of the 2017 10th International Congress on Image and Signal Proces-sing, Bio-Medical Engineering and Informatics, Shanghai, Oct 14-16, 2017. Piscataway: IEEE, 2017: 1-5.
[13] WU Y, ABD-ALMAGEED W, NATARAJAN P. Image copy-move tampering detection via an end-to-end deep neural net-work[C]//Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision, Lake Tahoe, Mar 12-15, 2018. Piscataway: IEEE, 2018: 1907-1915.
[14] LONG J, SHELHAMER E, DARRELL T. Fully convolu-tional networks for semantic segmentation[C]//Proceedings of the 2015 IEEE Conference on Computer Vision and Pat-tern Recognition, Boston, Jun 7-12, 2015. Washington: IEEE Computer Society, 2015: 3431-3440.
[15] WU Y, ABD-ALMAGEED W, NATARAJAN P. BusterNet: detecting copy-move image tampering with source/target localization[C]//LNCS 11210: Proceedings of the 15th Euro-pean Conference on Computer Vision, Munich, Sep 8-14, 2018. Cham: Springer, 2018: 170-186.
[16] CHEN B, TAN W, COATRIEUX G, et al. A serial image copy-move tampering localization scheme with source/target distin-guishment[J]. IEEE Transactions on Multimedia, 2021, 23: 3506-3517.
[17] HE K, ZHANG X, REN S, et al. Identity mappings in deep residual networks[C]//LNCS 9908: Proceedings of the 14th European Conference on Computer Vision, Amsterdam, Oct 11-14, 2016. Cham: Springer, 2016: 630-645.
[18] SANDLER M, HOWARD A, ZHU M, et al. MobileNetV2: inverted residuals and linear bottlenecks[C]//Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, Jun 18-23, 2018. Pisca-taway: IEEE, 2018: 4510-4520.
[19] CHOLLET F. Xception: deep learning with depthwise sepa-rable convolutions[C]//Proceedings of the 2017 IEEE Con-ference on Computer Vision and Pattern Recognition, Ho-nolulu, Jul 21-26, 2017. Washington: IEEE Computer Society, 2017: 1800-1807.
[20] SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[C]//Proceedings of the 3rd International Conference on Learning Represen-tations, San Diego, May 7-9, 2015: 1-15.
[21] WOO S, PARK J, LEE J Y, et al. CBAM: convolutional block attention module[C]//LNCS 11211: Proceedings of the 15th European Conference on Computer Vision, Munich, Sep 8-14, 2018. Cham: Springer, 2018: 3-19.
[22] CHEN L C, ZHU Y, PAPANDREOU G, et al. Encoder- decoder with atrous separable convolution for semantic image segmentation[C]//LNCS 11211: Proceedings of the 15th European Conference on Computer Vision, Munich, Sep 8-14, 2018. Cham: Springer, 2018: 833-851.
[23] ZHOU P, HAN X, MORARIU V I, et al. Learning rich features for image manipulation detection[C]//Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, Jun 18-23, 2018. Pisca-taway: IEEE, 2018: 1053-1061.
[24] FRIDRICH J, KODOVSKY J. Rich models for steganalysis of digital images[J]. IEEE Transactions on Information Forensics and Security, 2012, 7(3): 868-882.
[25] TRALIC D, ZUPANCIC I, GRGIC S, et al. CoMoFoD — new database for copy-move forgery detection[C]//Procee-dings of the ELMAR-2013, Zadar, Sep 25-27, 2013. Piscata-way: IEEE, 2013: 49-54.