3D-aware generative adversarial networks (GANs) synthesize high-fidelity and multi-view-consistent facial images using only collections of single-view 2D imagery. Towards fine-grained control over facial attributes, recent efforts incorporate 3D Morphable Face Model (3DMM) to describe deformation in generative radiance fields either explicitly or implicitly. Explicit methods provide fine-grained expression control but cannot handle topological changes caused by hair and accessories, while implicit ones can model varied topologies but have limited generalization caused by the unconstrained deformation fields. We propose a novel 3D GAN framework for unsupervised learning of generative, high-quality and 3D-consistent facial avatars from unstructured 2D images. To achieve both deformation accuracy and topological flexibility, we propose a 3D representation called Generative Texture-Rasterized Tri-planes. The proposed representation learns Generative Neural Textures on top of parametric mesh templates and then projects them into three orthogonal-viewed feature planes through rasterization, forming a tri-plane feature representation for volume rendering. In this way, we combine both fine-grained expression control of mesh-guided explicit deformation and the flexibility of implicit volumetric representation. We further propose specific modules for modeling mouth interior which is not taken into account by 3DMM. Our method demonstrates state-of-the-art 3D-aware synthesis quality and animation ability through extensive experiments. Furthermore, serving as 3D prior, our animatable 3D representation boosts multiple applications including one-shot facial avatars and 3D-aware stylization.
翻译:3D- 有色人种对抗网络(GANs) 合成高纤维和多视一致的面部图像。 为了对面部属性进行精细控制,最近的努力包括了3D 摩菲可容面部模型(DMM),以明示或暗示的方式描述突变显亮场域的变形。 清晰的方法提供了细微的表达控制,但无法处理由毛发和配件造成的地形变化,而隐含的方法可以模拟各种表层和多视一致的面部图像,但由于未受限制的变形场而导致的宽度和多视面面面面部图像。 我们提议了一个新型的3DGAN框架,用于对基因、高质量和3D型脸部进行无超超强的学习。 为了实现变形精度准确性和表面灵活性,我们提议了一个3D级的直径直径分析模型,我们用直径直的3D-直径分析模型,我们用3D-直径直径分析的直径直径表达方式将我们3-直立的直径直径直径直径直径代表制的3-直立的3-直立的3D-直径代表。</s>