论文标题

朝向图像矢量化

Towards Layer-wise Image Vectorization

论文作者

Ma, Xu, Zhou, Yuqian, Xu, Xingqian, Sun, Bin, Filev, Valerii, Orlov, Nikita, Fu, Yun, Shi, Humphrey

论文摘要

图像栅格化是计算机图形中的一种成熟技术,而图像矢量化是栅格化的反向路径,仍然是一个主要的挑战。最近的先进的基于深度学习的模型实现了向量图的矢量化和语义插值,并证明了产生新数字的更好拓扑。但是,深层模型不能轻易推广到室外测试数据。生成的SVG还包含复杂而冗余的形状,这些形状对于进一步的编辑不太方便。具体而言,图像中至关重要的层拓扑和基本语义仍然没有很好地理解,因此没有得到充分探索。在这项工作中,我们提出了层次图像矢量化,即现场,以将栅格图像转换为SVG并同时维护其图像拓扑。 Live可以产生紧凑的SVG形式,具有与人类视角一致的层结构。我们逐步添加新的Bezier路径,并通过层面框架,新设计的损耗功能和组件途径初始化技术优化这些路径。我们的实验表明,与先前的作品相比,现场表现出更合理的矢量形式,并且可以推广到新图像。 Live在这一新知识的拓扑结构的帮助下,为设计师和其他下游应用程序启动了人类可编辑的SVG。代码可在https://github.com/picsart-ai-research/live-layerwise-image-vectorization上提供。

Image rasterization is a mature technique in computer graphics, while image vectorization, the reverse path of rasterization, remains a major challenge. Recent advanced deep learning-based models achieve vectorization and semantic interpolation of vector graphs and demonstrate a better topology of generating new figures. However, deep models cannot be easily generalized to out-of-domain testing data. The generated SVGs also contain complex and redundant shapes that are not quite convenient for further editing. Specifically, the crucial layer-wise topology and fundamental semantics in images are still not well understood and thus not fully explored. In this work, we propose Layer-wise Image Vectorization, namely LIVE, to convert raster images to SVGs and simultaneously maintain its image topology. LIVE can generate compact SVG forms with layer-wise structures that are semantically consistent with human perspective. We progressively add new bezier paths and optimize these paths with the layer-wise framework, newly designed loss functions, and component-wise path initialization technique. Our experiments demonstrate that LIVE presents more plausible vectorized forms than prior works and can be generalized to new images. With the help of this newly learned topology, LIVE initiates human editable SVGs for both designers and other downstream applications. Codes are made available at https://github.com/Picsart-AI-Research/LIVE-Layerwise-Image-Vectorization.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源