Although GAN-based methods have received many achievements in the last few years, they have not been entirelysuccessful in generating discrete data. The most crucial challenge of these methods is the difficulty of passing the gradientfrom the discriminator to the generator when the generator outputs are discrete. Despite the fact that several attemptshave been made to alleviate this problem, none of the existing GAN-based methods have improved the performance oftext generation compared with the maximum likelihood approach in terms of both the quality and the diversity. In thispaper, we proposed a new framework for generating discrete data by an adversarial approach in which there is no need topass the gradient to the generator. The proposed method has an iterative manner in which each new generator is definedbased on the last discriminator. It leverages the discreteness of data and the last discriminator to model the real datadistribution implicitly. Moreover, the method is supported with theoretical guarantees, and experimental results generallyshow the superiority of the proposed DGSAN method compared to the other popular or recent methods in generatingdiscrete sequential data.
翻译:虽然基于GAN的方法在过去几年里取得了许多成就,但它们在生成离散数据方面并没有完全成功,这些方法的最关键挑战是,在生成器输出离散时,很难将偏差从偏差者向生成器传递到生成器中。尽管已作出若干努力来缓解这一问题,但现有的基于GAN的方法在质量和多样性方面都没有提高文本生成的性能,与最大可能性的方法相比,在质量和多样性方面都没有改善。在本文件中,我们提出了一个新的框架,通过对抗性方法生成离散数据,不需要将梯度通过到生成器中。提议的方法具有迭接方式,每个新生成器都以最后的偏差者为基础定义。它利用数据的离异性和最后一个偏差者隐含地模拟真实数据分配模式。此外,该方法得到理论保证的支持,实验结果通常显示拟议的DGSAN方法相对于生成不同连续数据的其他流行或最新方法的优越性。