This paper argues that generative art driven by conformance to a visual and/or semantic corpus lacks the necessary criteria to be considered creative. Among several issues identified in the literature, we focus on the fact that generative adversarial networks (GANs) that create a single image, in a vacuum, lack a concept of novelty regarding how their product differs from previously created ones. We envision that an algorithm that combines the novelty preservation mechanisms in evolutionary algorithms with the power of GANs can deliberately guide its creative process towards output that is both good and novel. In this paper, we use recent advances in image generation based on semantic prompts using OpenAI's CLIP model, interrupting the GAN's iterative process with short cycles of evolutionary divergent search. The results of evolution are then used to continue the GAN's iterative process; we hypothesise that this intervention will lead to more novel outputs. Testing our hypothesis using novelty search with local competition, a quality-diversity evolutionary algorithm that can increase visual diversity while maintaining quality in the form of adherence to the semantic prompt, we explore how different notions of visual diversity can affect both the process and the product of the algorithm. Results show that even a simplistic measure of visual diversity can help counter a drift towards similar images caused by the GAN. This first experiment opens a new direction for introducing higher intentionality and a more nuanced drive for GANs.
翻译:本文认为,由符合视觉和(或)语义特性所驱动的基因化艺术缺乏被认为具有创造性的必要标准。在文献中发现的若干问题中,我们侧重于以下事实:在真空中创造单一图像的基因对抗网络(GANs)在真空中缺乏关于其产品如何与以前创造的产品不同的新颖概念。我们设想,将进化算法中的新颖保存机制与GANs的力量结合起来的算法可以有意地指导其创造性过程,使其产生既好又新颖的产出。在本文中,我们利用OpenAI的CLIP模型,利用语义性提示的图像生成的最新进展,中断GAN的迭代过程,进行演进式不同搜索的短周期。然后,进化的结果被用来继续GAN的迭代过程;我们假设,这种干预将导致更新颖的产出。我们用新颖的搜索,即质量多样化的进化算法,可以提高视觉多样性的质量,同时保持对语义性快速的坚持形式。我们探索视觉多样性的不同概念如何影响GAN的迭代过程,而使GAN的更接近性演算法成为新的GAN的流动。