In recent years, facial makeup transfer has attracted growing attention due to its efficiency and flexibility in transferring makeup styles between different faces. Although recent works have achieved realistic results, most of them fail to handle heavy makeup styles with multiple colors and subtle details. Hence we propose a novel GAN model to handle heavy makeup transfer, while maintaining the robustness to different poses and expressions. Firstly, a Makeup Multi-Extraction Network is introduced to learn region-wise makeup features from multiple layers. Then, a key transferring module called Detailed Region-Adaptive Normalization is proposed to fuse different levels of makeup styles in an adaptive way, making great improvement to the quality of heavy makeup transfer. With the outputs from the two components, Makeup Transfer Network is used to perform makeup transfer. To evaluate the efficacy of our proposed method, we collected a new makeup dataset containing a wide range of heavy styles. Experiments show that our method achieves state-of-the-art results both on light and heavy makeup styles, and is robust to different poses and expressions.
翻译:近些年来,面部化妆品转移因其在不同面孔之间转让化妆品样式的效率和灵活性而引起越来越多的关注。虽然最近的工作取得了现实的结果,但大部分没有处理具有多种颜色和微妙细节的重化妆风格。因此,我们提议了一个新型的GAN模型来处理重化妆转让,同时保持对不同面容和表达方式的坚固性。首先,引入了一个多提取网络,以学习多层的区域化化妆品特征。然后,建议了一个称为详细区域适应性正常化的关键转移模块,以适应的方式整合不同层次的化妆品样式,大大改进了重化妆品转让的质量。由于这两个组成部分的产出,化妆品转移网络被用来进行化妆品转让。为了评估我们拟议方法的效力,我们收集了一套包含广泛各种重风格的新化妆数据集。实验显示,我们的方法在轻重化妆品和重化妆品样式上都取得了最新的结果,并且对不同面容和表达方式十分健全。