Recent years have witnessed significant growth of face alignment. Though dense facial landmark is highly demanded in various scenarios, e.g., cosmetic medicine and facial beautification, most works only consider sparse face alignment. To address this problem, we present a framework that can enrich landmark density by existing sparse landmark datasets, e.g., 300W with 68 points and WFLW with 98 points. Firstly, we observe that the local patches along each semantic contour are highly similar in appearance. Then, we propose a weakly-supervised idea of learning the refinement ability on original sparse landmarks and adapting this ability to enriched dense landmarks. Meanwhile, several operators are devised and organized together to implement the idea. Finally, the trained model is applied as a plug-and-play module to the existing face alignment networks. To evaluate our method, we manually label the dense landmarks on 300W testset. Our method yields state-of-the-art accuracy not only in newly-constructed dense 300W testset but also in the original sparse 300W and WFLW testsets without additional cost.
翻译:近些年来,面部对比出现了显著增长。尽管在各种情景中,如化妆医学和面部美化等,面部密集的标志性标志性要求很高,但大多数工作只考虑面部疏松。为了解决这个问题,我们提出了一个框架,通过现有的稀疏地标数据集,例如300W,68个点,WFLW,98个点,来丰富地标密度。首先,我们观察到,每个语义轮廓的局部补丁在外观上非常相似。然后,我们提出了一个微弱、受监督的构想,即学习原始稀疏地标本上的精密能力,并调整这种能力以适应浓密地标。与此同时,设计并组织了若干操作员,共同实施这一构想。最后,经过培训的模型作为插接和游戏模块应用到现有的脸部校准网络中。为了评估我们的方法,我们手动将密集的地标标标标在300W测试点上。我们的方法不仅在新制造的密度300W测试中,而且在原始的300W和WLFLW试验室中产生最新的精确度。