论文标题
Pugeo-net:一个以几何为中心网络,用于3D点云上采样
PUGeo-Net: A Geometry-centric Network for 3D Point Cloud Upsampling
论文作者
论文摘要
本文解决了产生均匀的致密点云的问题,以描述给定的稀疏点云中的基本几何结构。由于不规则和无序的性质,点云致密性作为生成任务是具有挑战性的。为了应对挑战,我们提出了一种新颖的基于神经网络的方法,即Pugeo-net,该方法将学习每个输入点的$ 3 \ times 3 $线性转换矩阵$ \ bf t $。矩阵$ \ mathbf t $近似于局部参数化的增强雅各布矩阵,并在2D参数域和3D切线平面之间建立一对一的对应关系,以便我们可以将自适应分布的2D样品(也从数据中学到)到3D空间。之后,我们通过沿切线平面的正常计算位移来将样品投射到弯曲表面。 Pugeo-NET与现有的深度学习方法根本不同,后者在很大程度上是由图像超分辨率技术激励的,并在抽象特征空间中生成了新点。由于其以几何形式的性质,Pugeo-net可以很好地适用于具有鲜明功能的CAD型号和具有丰富几何细节的扫描模型。此外,Pugeo-NET可以计算原始和生成点的正常,这是表面重建算法高度渴望的。计算结果表明,Pugeo-net是第一个可以共同生成顶点坐标和正常的神经网络,在上采样因子$ 4 \ sim 16 $方面,在准确性和效率方面始终优于最先进的神经网络。
This paper addresses the problem of generating uniform dense point clouds to describe the underlying geometric structures from given sparse point clouds. Due to the irregular and unordered nature, point cloud densification as a generative task is challenging. To tackle the challenge, we propose a novel deep neural network based method, called PUGeo-Net, that learns a $3\times 3$ linear transformation matrix $\bf T$ for each input point. Matrix $\mathbf T$ approximates the augmented Jacobian matrix of a local parameterization and builds a one-to-one correspondence between the 2D parametric domain and the 3D tangent plane so that we can lift the adaptively distributed 2D samples (which are also learned from data) to 3D space. After that, we project the samples to the curved surface by computing a displacement along the normal of the tangent plane. PUGeo-Net is fundamentally different from the existing deep learning methods that are largely motivated by the image super-resolution techniques and generate new points in the abstract feature space. Thanks to its geometry-centric nature, PUGeo-Net works well for both CAD models with sharp features and scanned models with rich geometric details. Moreover, PUGeo-Net can compute the normal for the original and generated points, which is highly desired by the surface reconstruction algorithms. Computational results show that PUGeo-Net, the first neural network that can jointly generate vertex coordinates and normals, consistently outperforms the state-of-the-art in terms of accuracy and efficiency for upsampling factor $4\sim 16$.