论文标题
具有辅助照明的对抗图像组成
Adversarial Image Composition with Auxiliary Illumination
论文作者
论文摘要
处理前景对象与背景图像之间的不一致性是高保真图像组成中的一项具有挑战性的任务。最先进的方法努力通过调整前景对象的样式与背景图像兼容,而构成图像中的前景对象的潜在阴影在很大程度上被忽略了。在本文中,我们提出了一个对抗性图像组成网(AIC-NET),该网络通过考虑构成图像中前景对象投射的潜在阴影来实现逼真的图像组成。提出了一种新颖的分支生成机制,该机制散布了阴影的产生和前景样式的转移,以同时完成这两个任务。设计了一个可区分的空间变换模块,该模块桥接了局部协调和全球协调,以有效地实现其关节优化。对行人和汽车组成任务的广泛实验表明,所提出的AIC-NET在定性和定量上实现了出色的组成性能。
Dealing with the inconsistency between a foreground object and a background image is a challenging task in high-fidelity image composition. State-of-the-art methods strive to harmonize the composed image by adapting the style of foreground objects to be compatible with the background image, whereas the potential shadow of foreground objects within the composed image which is critical to the composition realism is largely neglected. In this paper, we propose an Adversarial Image Composition Net (AIC-Net) that achieves realistic image composition by considering potential shadows that the foreground object projects in the composed image. A novel branched generation mechanism is proposed, which disentangles the generation of shadows and the transfer of foreground styles for optimal accomplishment of the two tasks simultaneously. A differentiable spatial transformation module is designed which bridges the local harmonization and the global harmonization to achieve their joint optimization effectively. Extensive experiments on pedestrian and car composition tasks show that the proposed AIC-Net achieves superior composition performance qualitatively and quantitatively.