论文标题
使用LSFM模型实时单眼4D面部重建
Real-Time Monocular 4D Face Reconstruction using the LSFM models
论文作者
论文摘要
单个相机的4D面重建是一项具有挑战性的任务，尤其是当需要实时执行时。我们演示了我们自己实施的系统，该系统可以准确地解决此任务，并使用网络摄像头作为唯一的输入，并在商品笔记本电脑上实时运行。我们的系统是交互式的，使用户可以自由移动头部并在摄像机前显示各种表情。结果，提出的系统既重建和可视化主题的身份，并实时与作用的面部表情一起。我们框架中的4D重建基于最近发布的大型面部模型（LSFM）\ cite {lsfm1，lsfm2}，它们是有史以来最大的面部形状的3D形态模型，该模型是基于从一个超过10,000个面部标识的数据集中建立的最大的面部形状模型。这是第一个实时演示，使用户有机会在实践中测试最近发布的大规模面部模型（LSFM）的功能。
4D face reconstruction from a single camera is a challenging task, especially when it is required to be performed in real time. We demonstrate a system of our own implementation that solves this task accurately and runs in real time on a commodity laptop, using a webcam as the only input. Our system is interactive, allowing the user to freely move their head and show various expressions while standing in front of the camera. As a result, the put forward system both reconstructs and visualises the identity of the subject in the correct pose along with the acted facial expressions in real-time. The 4D reconstruction in our framework is based on the recently-released Large-Scale Facial Models (LSFM) \cite{LSFM1, LSFM2}, which are the largest-scale 3D Morphable Models of facial shapes ever constructed, based on a dataset of more than 10,000 facial identities from a wide range of gender, age and ethnicity combinations. This is the first real-time demo that gives users the opportunity to test in practice the capabilities of the recently-released Large-Scale Facial Models (LSFM)
