Nowadays, the wide application of virtual digital human promotes the comprehensive prosperity and development of digital culture supported by digital economy. The personalized portrait automatically generated by AI technology needs both the natural artistic style and human sentiment. In this paper, we propose a novel StyleIdentityGAN model, which can ensure the identity and artistry of the generated portrait at the same time. Specifically, the style-enhanced module focuses on artistic style features decoupling and transferring to improve the artistry of generated virtual face images. Meanwhile, the identity-enhanced module preserves the significant features extracted from the input photo. Furthermore, the proposed method requires a small number of reference style data. Experiments demonstrate the superiority of StyleIdentityGAN over state-of-art methods in artistry and identity effects, with comparisons done qualitatively, quantitatively and through a perceptual user study. Code has been released on Github3.
翻译:目前,虚拟数字人的广泛应用促进了数字经济所支持的数字文化的全面繁荣和发展。由人工智能技术自动产生的个性化肖像需要自然艺术风格和人情味。在本文中,我们提出一个新的“风格身份GAN”模型,可以同时确保所生成的肖像的特性和艺术性。具体地说,风格强化模块侧重于艺术风格特征的脱钩和转让,以改善所生成的虚拟面像的艺术性能。同时,身份强化模块保留了从输入照片中提取的重要特征。此外,拟议方法需要少量的参考风格数据。实验表明“风格身份GAN”优于艺术和身份效果方面的最新方法,通过定性、定量和感知性用户研究进行比较。代码已在Github3上发布。</s>