论文标题

3D面对通过表面参数化和2D语义分割网络解析

3D Face Parsing via Surface Parameterization and 2D Semantic Segmentation Network

论文作者

Sun, Wenyuan, Zhou, Ping, Wang, Yangang, Yu, Zongpu, Jin, Jing, Zhou, Guangquan

论文摘要

面部解析将像素语义标签分配为计算机的面部表示,这是许多高级面部技术的基本组成部分。与2D面对解析相比,3D面对解析具有更大的潜力,可以实现更好的性能和进一步的应用,但是由于3D网格数据计算,它仍然具有挑战性。最近的作品引入了3D表面分割的不同方法,而性能仍然有限。在本文中,我们提出了一种基于“ 3D-2D-3D”策略来完成3D面对解析的方法。包含空间和纹理信息的拓扑磁盘状2D面图像通过面部参数化算法从采样的3D面数据转换,并提出了一个名为CPFNET的特定2D网络,以实现具有多刻度技术和特征聚集的2D参数化面数据的语义分割。然后,2D语义结果将成反比3D面数据,最终实现了3D面对解析。实验结果表明,CPFNET和“ 3D-2D-3D”策略都完成了高质量的3D面对解析和跑赢大于最新的2D网络,以及定性和定量比较的3D方法。

Face parsing assigns pixel-wise semantic labels as the face representation for computers, which is the fundamental part of many advanced face technologies. Compared with 2D face parsing, 3D face parsing shows more potential to achieve better performance and further application, but it is still challenging due to 3D mesh data computation. Recent works introduced different methods for 3D surface segmentation, while the performance is still limited. In this paper, we propose a method based on the "3D-2D-3D" strategy to accomplish 3D face parsing. The topological disk-like 2D face image containing spatial and textural information is transformed from the sampled 3D face data through the face parameterization algorithm, and a specific 2D network called CPFNet is proposed to achieve the semantic segmentation of the 2D parameterized face data with multi-scale technologies and feature aggregation. The 2D semantic result is then inversely re-mapped to 3D face data, which finally achieves the 3D face parsing. Experimental results show that both CPFNet and the "3D-2D-3D" strategy accomplish high-quality 3D face parsing and outperform state-of-the-art 2D networks as well as 3D methods in both qualitative and quantitative comparisons.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源