In recent years, arbitrary image style transfer has attracted more and more attention. Given a pair of content and style images, a stylized one is hoped that retains the content from the former while catching style patterns from the latter. However, it is difficult to simultaneously keep well the trade-off between the content details and the style features. To stylize the image with sufficient style patterns, the content details may be damaged and sometimes the objects of images can not be distinguished clearly. For this reason, we present a new transformer-based method named STT for image style transfer and an edge loss which can enhance the content details apparently to avoid generating blurred results for excessive rendering on style features. Qualitative and quantitative experiments demonstrate that STT achieves comparable performance to state-of-the-art image style transfer methods while alleviating the content leak problem.
翻译:近年来,任意的图像风格传输吸引了越来越多的关注。 鉴于一对内容和风格图像, 一种标准化的图像有望保留内容, 同时从样式中捕捉到样式模式。 但是, 很难同时保持内容细节和样式特征之间的平衡。 要以足够的样式模式将图像结构化, 内容细节可能会受损, 有时图像对象无法被明确区分。 因此, 我们提出了一种新的基于变压器的图像风格传输方法, 名为 STT, 用于图像样式传输, 以及边缘损失, 它可以加强内容细节, 明显避免在样式特征上过度展示产生模糊的结果。 定性和定量实验表明, STT在缓解内容泄漏问题的同时, 取得了与最新图像风格传输方法相似的性能。