With the advent of generative adversarial networks, synthesizing images from textual descriptions has recently become an active research area. It is a flexible and intuitive way for conditional image generation with significant progress in the last years regarding visual realism, diversity, and semantic alignment. However, the field still faces several challenges that require further research efforts such as enabling the generation of high-resolution images with multiple objects, and developing suitable and reliable evaluation metrics that correlate with human judgement. In this review, we contextualize the state of the art of adversarial text-to-image synthesis models, their development since their inception five years ago, and propose a taxonomy based on the level of supervision. We critically examine current strategies to evaluate text-to-image synthesis models, highlight shortcomings, and identify new areas of research, ranging from the development of better datasets and evaluation metrics to possible improvements in architectural design and model training. This review complements previous surveys on generative adversarial networks with a focus on text-to-image synthesis which we believe will help researchers to further advance the field.
翻译:随着基因对抗网络的出现,从文字描述中合成图像最近已成为一个积极的研究领域,这是在过去几年里在视觉现实主义、多样性和语义一致方面取得重大进展的有条件图像生成的一种灵活和直观的方式,但是,外地仍然面临一些需要进一步研究的挑战,例如,能够生成多物体的高分辨率图像,以及制定与人类判断相关的适当和可靠的评价指标。在本次审查中,我们结合了对抗文字到图像合成模型的先进程度,自五年前开始以来这些模型的开发,并提出了基于监督程度的分类法。我们严格审查当前战略,以评价文字到图像综合模型,突出缺点,并确定新的研究领域,从开发更好的数据集和评价指标到建筑设计和模型培训的可能改进。本审查补充了以前对基因对抗网络的调查,重点是文本到图像合成,我们认为这将有助于研究人员进一步推进实地工作。