The training of generative adversarial networks (GANs) is usually vulnerable to mode collapse and vanishing gradients. The evolutionary generative adversarial network (E-GAN) attempts to alleviate these issues by optimizing the learning strategy with multiple loss functions. It uses a learning-based evolutionary framework, which develops new mutation operators specifically for general deep neural networks. However, the evaluation mechanism in the fitness function of E-GAN cannot truly reflect the adaptability of individuals to their environment, leading to an inaccurate assessment of the diversity of individuals. Moreover, the evolution step of E-GAN only contains mutation operators without considering the crossover operator jointly, isolating the superior characteristics among individuals. To address these issues, we propose an improved E-GAN framework called IE-GAN, which introduces a new fitness function and a generic crossover operator. In particular, the proposed fitness function, from an objective perspective, can model the evolutionary process of individuals more accurately. The crossover operator, which has been commonly adopted in evolutionary algorithms, can enable offspring to imitate the superior gene expression of their parents through knowledge distillation. Experiments on various datasets demonstrate the effectiveness of our proposed IE-GAN in terms of the quality of the generated samples and time efficiency.
翻译:基因对抗网络(GANs)的培训通常容易受到模式崩溃和消失梯度的伤害。进化基因对抗网络(E-GAN)试图通过优化具有多重损失功能的学习战略来缓解这些问题。它使用一个基于学习的进化框架,专门为普通深神经网络开发新的突变操作器;然而,E-GAN健身功能的评价机制不能真正反映个人适应环境的适应性,导致对个人多样性的评估不准确。此外,E-GAN的演进步骤仅包含突变操作器,而没有考虑交叉操作器,分离个人之间的优越特征。为了解决这些问题,我们提议了一个称为IE-GAN的改进E-GAN框架,其中引入了新的健身功能和一个通用交叉操作器。特别是,拟议的健身功能从客观角度来说,能够更准确地模拟个人的进化过程。进化算法中通常采用的交叉操作器,能够使后代通过知识蒸馏来模仿其父母的优异基因表达。在各种时间设置方面进行实验,展示了我们提议的IG-G条件的样品的效率。