论文标题

块洗车学习以进行深泡沫检测

Block shuffling learning for Deepfake Detection

论文作者

Liu, Sitong, Lian, Zhichao, Gu, Siqi, Xiao, Liang

论文摘要

基于卷积神经网络(CNN)的DeepFake检测方法表现出很高的精度。 \ textColor {black} {但是,当面对未知的伪造方法和诸如调整和模糊大小的常见转换时,这些方法通常会遭受性能的降低,从而导致训练和测试域之间的偏差。}这种现象(称为过度拟合)构成了重大挑战。为了解决这个问题,我们提出了一种新颖的块洗牌正则化方法。首先,我们的方法涉及将图像分为块,并应用块内和块间隔技术。这个过程间接地实现了不同维度的体重分享。其次,我们引入了一种对抗性损失算法,以减轻改组噪声引起的过度拟合问题。最后,我们恢复了块的空间布局,以捕获它们之间的语义关联。广泛的实验验证了我们提出的方法的有效性,该方法超过了伪造的面部检测方法。值得注意的是,我们的方法具有出色的概括能力,证明了针对跨数据库评估和共同图像转换的鲁棒性。特别是我们的方法可以轻松地与各种CNN模型集成。源代码可在\ href {https://github.com/nowindbutrain/blockshufflelearning} {github}获得。

Deepfake detection methods based on convolutional neural networks (CNN) have demonstrated high accuracy. \textcolor{black}{However, these methods often suffer from decreased performance when faced with unknown forgery methods and common transformations such as resizing and blurring, resulting in deviations between training and testing domains.} This phenomenon, known as overfitting, poses a significant challenge. To address this issue, we propose a novel block shuffling regularization method. Firstly, our approach involves dividing the images into blocks and applying both intra-block and inter-block shuffling techniques. This process indirectly achieves weight-sharing across different dimensions. Secondly, we introduce an adversarial loss algorithm to mitigate the overfitting problem induced by the shuffling noise. Finally, we restore the spatial layout of the blocks to capture the semantic associations among them. Extensive experiments validate the effectiveness of our proposed method, which surpasses existing approaches in forgery face detection. Notably, our method exhibits excellent generalization capabilities, demonstrating robustness against cross-dataset evaluations and common image transformations. Especially our method can be easily integrated with various CNN models. Source code is available at \href{https://github.com/NoWindButRain/BlockShuffleLearning}{Github}.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源