论文标题

保持积极:非负面图像综合用于增强现实

Stay Positive: Non-Negative Image Synthesis for Augmented Reality

论文作者

Luo, Katie, Yang, Guandao, Xian, Wenqi, Haraldsson, Harald, Hariharan, Bharath, Belongie, Serge

论文摘要

在诸如光学透明和投影仪之类的应用中,增强现实的现实,形成图像等于求解非负图像生成,其中只能为现有图像添加光。但是,大多数图像生成方法都不适合此问题设置,因为它们假设可以为每个像素分配任意颜色。实际上,即使在诸如MNIST数字之类的简单域中,现有方法的幼稚应用也会失败,因为一个人无法通过添加光创建较暗的像素。但是,我们知道,人类的视觉系统可以被涉及某些亮度和对比度的空间配置的错觉所欺骗。我们的关键见解是,人们可以利用这种行为以微不足道的伪影产生高质量的图像。例如,我们可以通过使周围的像素亮度来创建深色斑块的错觉。我们提出了一种新颖的优化程序,以产生满足语义和非阴性约束的图像。我们的方法可以结合现有的最新方法,并在各种任务中表现出强大的性能,包括图像到图像翻译和样式转移。

In applications such as optical see-through and projector augmented reality, producing images amounts to solving non-negative image generation, where one can only add light to an existing image. Most image generation methods, however, are ill-suited to this problem setting, as they make the assumption that one can assign arbitrary color to each pixel. In fact, naive application of existing methods fails even in simple domains such as MNIST digits, since one cannot create darker pixels by adding light. We know, however, that the human visual system can be fooled by optical illusions involving certain spatial configurations of brightness and contrast. Our key insight is that one can leverage this behavior to produce high quality images with negligible artifacts. For example, we can create the illusion of darker patches by brightening surrounding pixels. We propose a novel optimization procedure to produce images that satisfy both semantic and non-negativity constraints. Our approach can incorporate existing state-of-the-art methods, and exhibits strong performance in a variety of tasks including image-to-image translation and style transfer.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源