The goal of human stylization is to transfer full-body human photos to a style specified by a single art character reference image. Although previous work has succeeded in example-based stylization of faces and generic scenes, full-body human stylization is a more complex domain. This work addresses several unique challenges of stylizing full-body human images. We propose a method for one-shot fine-tuning of a pose-guided human generator to preserve the "content" (garments, face, hair, pose) of the input photo and the "style" of the artistic reference. Since body shape deformation is an essential component of an art character's style, we incorporate a novel skeleton deformation module to reshape the pose of the input person and modify the DiOr pose-guided person generator to be more robust to the rescaled poses falling outside the distribution of the realistic poses that the generator is originally trained on. Several human studies verify the effectiveness of our approach.
翻译:目标是将全身人像转移到由单个艺术角色参考图像指定的风格。尽管先前的工作已经成功地在面部和通用场景上进行了基于示例的风格化,但全身人体的风格化是一个更复杂的领域。本文解决了风格化全身人像的几个独特挑战。我们提出了一种姿势引导的人类生成器的一次性微调方法,以保留输入照片的“内容”(服装、脸部、头发、姿势)和艺术参考的“风格”。由于身体形态变化是艺术角色风格的必要组成部分,因此我们加入了一个新颖的骨架变形模块来重新塑造输入人的姿势,并修改DiOr姿势引导的人类生成器,使其对落在生成器最初训练的真实姿势分布之外的缩放姿势更具鲁棒性。几项人类研究验证了我们的方法的有效性。