We present an end-to-end virtual try-on pipeline, that can fit different clothes on a personalized 3-D human model, reconstructed using a single RGB image. Our main idea is to construct an animatable 3-D human model and try-on different clothes in a 3-D virtual environment. The existing frame by frame volumetric reconstruction of 3-D human models are highly resource-demanding and do not allow clothes switching. Moreover, existing virtual fit-on systems also lack realism due to predominantly being 2-D or not using user's features in the reconstruction. These shortcomings are due to either the human body or clothing model being 2-D or not having the user's facial features in the dressed model. We solve these problems by manipulating a parametric representation of the 3-D human body model and stitching a head model reconstructed from the actual image. Fitting the 3-D clothing models on the parameterized human model is also adjustable to the body shape of the input image. Our reconstruction results, in comparison with recent existing work, are more visually-pleasing.
翻译:我们展示了一个端到端虚拟试管管道,可以在个性化的三维人模型上安装不同的衣服,用单一的 RGB 图像重建。 我们的主要想法是建立一个可想象的三维人模型,在3D 虚拟环境中试穿不同的衣服。 通过3D 人模型的体积重建,现有的框架非常需要资源,不允许换衣服。此外,现有的虚拟适配系统也缺乏现实性,因为主要是2D 或没有在重建中使用用户的特征。这些缺陷要么是由于人体或服装模型是2D 或没有在装饰模型中显示用户的面部特征。我们解决这些问题的方法是操纵3D 人体模型的准度表示法,并根据实际图像来缝合一个头型模型。在参数化的人类模型上安装三维服装模型,也能够与输入图像的体形进行调整。与最近的工程相比,我们的重建结果更具有视觉效果。