论文标题

人类感知的运动去膨胀

Human-Aware Motion Deblurring

论文作者

Shen, Ziyi, Wang, Wenguan, Lu, Xiankai, Shen, Jianbing, Ling, Haibin, Xu, Tingfa, Shao, Ling

论文摘要

本文提出了一种人类意识的脱蓝色模型,该模型可以解散前景(FG)人类和背景(BG)之间的运动模糊。所提出的模型基于三个分支编码器架构。学到了前两个分支,分别用于锐化FG人类和BG细节。尽管第三个通过全面融合了两个域中的多尺度脱脂信息,从而产生了全球,和谐的结果。拟议的模型以端到端的方式进一步赋予了有监督的人类意识的注意机制。它学习了一个柔软的面膜,该面膜编码FG人类信息并明确驱动FG/BG解码器分支以专注于其特定域。为了进一步有益于对人类感知的图像Deblurring的研究,我们引入了一个名为HIDE的大规模数据集,该数据集由8,422个模糊和尖锐的图像对组成,并带有65,784个密集注释的FG人体边界盒。隐藏是专门为跨越广泛的场景,人体物体大小,运动模式和背景复杂性而建造的。对公共基准和我们的数据集进行了广泛的实验表明,我们的模型对最先进的运动去膨胀方法的表现有利,尤其是在捕获语义细节时。

This paper proposes a human-aware deblurring model that disentangles the motion blur between foreground (FG) humans and background (BG). The proposed model is based on a triple-branch encoder-decoder architecture. The first two branches are learned for sharpening FG humans and BG details, respectively; while the third one produces global, harmonious results by comprehensively fusing multi-scale deblurring information from the two domains. The proposed model is further endowed with a supervised, human-aware attention mechanism in an end-to-end fashion. It learns a soft mask that encodes FG human information and explicitly drives the FG/BG decoder-branches to focus on their specific domains. To further benefit the research towards Human-aware Image Deblurring, we introduce a large-scale dataset, named HIDE, which consists of 8,422 blurry and sharp image pairs with 65,784 densely annotated FG human bounding boxes. HIDE is specifically built to span a broad range of scenes, human object sizes, motion patterns, and background complexities. Extensive experiments on public benchmarks and our dataset demonstrate that our model performs favorably against the state-of-the-art motion deblurring methods, especially in capturing semantic details.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源