论文标题

Humangen:用明确的先验产生人类辐射场

HumanGen: Generating Human Radiance Fields with Explicit Priors

论文作者

Jiang, Suyi, Jiang, Haoran, Wang, Ziyu, Luo, Haimin, Chen, Wenzheng, Xu, Lan

论文摘要

近年来,3D甘斯(3D Gans)在产生了具有照相真实主义的视野一致的辐射场方面取得了巨大进展。然而,高质量的人类辐射场仍然具有挑战性,部分原因是现有方法中与人类相关的先验有限。我们提出了Humangen,这是一种具有详细几何形状和$ \ text {360}^{\ circ} $现实的自由视图渲染的新颖3D人类一代方案。它通过设计“锚图像”的设计明确将3D人类一代与人类的各种先验结合。我们使用锚图映像引入了混合功能表示形式,以用现有的2D发电机桥接Hangen的潜在空间。然后,我们采用了钢筋设计来消除几何和外观的产生。借助锚图像,我们适应了3D重建器以合成细颗粒细节,并提出了一个两阶段的混合方案,以增强外观产生。广泛的实验证明了我们在几何细节,纹理质量和自由观看性能方面对最先进的3D人类一代的有效性。值得注意的是,Humangen还可以结合各种现成的2D潜在编辑方法,无缝将其提升为3D。

Recent years have witnessed the tremendous progress of 3D GANs for generating view-consistent radiance fields with photo-realism. Yet, high-quality generation of human radiance fields remains challenging, partially due to the limited human-related priors adopted in existing methods. We present HumanGen, a novel 3D human generation scheme with detailed geometry and $\text{360}^{\circ}$ realistic free-view rendering. It explicitly marries the 3D human generation with various priors from the 2D generator and 3D reconstructor of humans through the design of "anchor image". We introduce a hybrid feature representation using the anchor image to bridge the latent space of HumanGen with the existing 2D generator. We then adopt a pronged design to disentangle the generation of geometry and appearance. With the aid of the anchor image, we adapt a 3D reconstructor for fine-grained details synthesis and propose a two-stage blending scheme to boost appearance generation. Extensive experiments demonstrate our effectiveness for state-of-the-art 3D human generation regarding geometry details, texture quality, and free-view performance. Notably, HumanGen can also incorporate various off-the-shelf 2D latent editing methods, seamlessly lifting them into 3D.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源