We propose a flexible person generation framework called Dressing in Order (DiOr), which supports 2D pose transfer, virtual try-on, and several fashion editing tasks. The key to DiOr is a novel recurrent generation pipeline to sequentially put garments on a person, so that trying on the same garments in different orders will result in different looks. Our system can produce dressing effects not achievable by existing work, including different interactions of garments (e.g., wearing a top tucked into the bottom or over it), as well as layering of multiple garments of the same type (e.g., jacket over shirt over t-shirt). DiOr explicitly encodes the shape and texture of each garment, enabling these elements to be edited separately. Joint training on pose transfer and inpainting helps with detail preservation and coherence of generated garments. Extensive evaluations show that DiOr outperforms other recent methods like ADGAN in terms of output quality, and handles a wide range of editing functions for which there is no direct supervision.
翻译:我们提出一个灵活的人造框架,名为“按顺序穿戴”(DiOr),它支持 2D 摆装、虚拟试穿和若干时装编辑任务。DiOr 的关键是一个新的重复一代管道,按照顺序将服装放在一个人身上,这样在不同顺序上试穿相同的服装将产生不同的外观。我们的系统可以产生现有工作无法实现的外衣效果,包括不同的服装互动(例如,穿戴顶部套在底部或上方),以及同一类型多件服装的分层(例如,衬衫上的外套在T恤衫上),DiOr 明确编码每件服装的形状和纹理,使这些元素能够分别编辑。关于调装和涂料的联合培训有助于所制服装的详细保存和一致性。广泛的评估显示,Dior 的外衣在产出质量方面超越了ADGAN等其他最新方法,并处理一系列没有直接监督的编辑职能。