论文标题
当心!运动模糊了您的深神经网络的愿景
Watch out! Motion is Blurring the Vision of Your Deep Neural Networks
论文作者
论文摘要
最新的深层神经网络(DNN)对具有添加剂随机噪声扰动的对抗性示例很容易受到伤害。尽管在物理世界中几乎没有找到这样的例子,但另一方面,由对象运动引起的图像模糊效果通常是在实践中发生的,这使得研究非常重要,尤其是对于广泛采用的实时图像处理任务(例如,对象检测,跟踪,跟踪)。在本文中,我们启动了第一步,以全面研究由对象运动引起的DNN的模糊效应的潜在危害。我们提出了一种新型的对抗攻击方法,该方法可以生成视觉上自然的运动性对抗性示例,称为基于运动的对抗模糊攻击(ABBA)。为此,我们首先制定了基于内核预测的攻击,其中输入图像以像素的方式与内核进行卷积,并且通过调整内核重量来实现错误分类能力。为了产生视觉上更自然和更合理的示例,我们进一步提出了显着性的对抗内核预测,在该预测中,显着区域是一个运动对象,并且预测的内核被正常化以实现自然视觉效果。此外,通过自适应调整对象和背景的翻译,进一步增强了攻击。对Neurips'17对抗竞争数据集的全面评估通过考虑各种内核大小,翻译和区域来证明ABBA的有效性。深入研究进一步证实,与其他模糊方法相比,我们的方法对基于GAN的脱毛机制显示出更有效的穿透能力。我们将代码发布到https://github.com/tsingqguo/abba。
The state-of-the-art deep neural networks (DNNs) are vulnerable against adversarial examples with additive random-like noise perturbations. While such examples are hardly found in the physical world, the image blurring effect caused by object motion, on the other hand, commonly occurs in practice, making the study of which greatly important especially for the widely adopted real-time image processing tasks (e.g., object detection, tracking). In this paper, we initiate the first step to comprehensively investigate the potential hazards of the blur effect for DNN, caused by object motion. We propose a novel adversarial attack method that can generate visually natural motion-blurred adversarial examples, named motion-based adversarial blur attack (ABBA). To this end, we first formulate the kernel-prediction-based attack where an input image is convolved with kernels in a pixel-wise way, and the misclassification capability is achieved by tuning the kernel weights. To generate visually more natural and plausible examples, we further propose the saliency-regularized adversarial kernel prediction, where the salient region serves as a moving object, and the predicted kernel is regularized to achieve naturally visual effects. Besides, the attack is further enhanced by adaptively tuning the translations of object and background. A comprehensive evaluation on the NeurIPS'17 adversarial competition dataset demonstrates the effectiveness of ABBA by considering various kernel sizes, translations, and regions. The in-depth study further confirms that our method shows more effective penetrating capability to the state-of-the-art GAN-based deblurring mechanisms compared with other blurring methods. We release the code to https://github.com/tsingqguo/ABBA.