Despite recent progress in generative adversarial network(GAN)-based vocoders, where the model generates raw waveform conditioned on mel spectrogram, it is still challenging to synthesize high-fidelity audio for numerous speakers across varied recording environments. In this work, we present BigVGAN, a universal vocoder that generalizes well under various unseen conditions in zero-shot setting. We introduce periodic nonlinearities and anti-aliased representation into the generator, which brings the desired inductive bias for waveform synthesis and significantly improves audio quality. Based on our improved generator and the state-of-the-art discriminators, we train our GAN vocoder at the largest scale up to 112M parameters, which is unprecedented in the literature. In particular, we identify and address the training instabilities specific to such scale, while maintaining high-fidelity output without over-regularization. Our BigVGAN achieves the state-of-the-art zero-shot performance for various out-of-distribution scenarios, including new speakers, novel languages, singing voices, music and instrumental audio in unseen (even noisy) recording environments. We will release our code and model at: https://github.com/NVIDIA/BigVGAN
翻译:尽管在基因对抗网络(GAN)基于蒸馏器方面最近取得了进展,模型生成了以光谱光谱为条件的原始波形,但对于不同录音环境中的众多发言者来说,合成高非异端音频仍是一项艰巨的任务。在这项工作中,我们介绍了BigVGAN,这是一个普遍的VGAN, 它在各种不可见的条件下,在零发状态下非常普遍;我们向发电机引入了定期的非线性和反反反信号的表达方式,它为波形合成带来了理想的感应偏差,并大大提高了音频质量。根据我们改进的发电机和最先进的导师,我们培训我们的GAN vocoder, 在最大程度上达到112M参数,这在文献中是前所未有的。特别是,我们发现并解决了与这种规模相关的培训不稳性,同时保持高非常态输出,而不会过度常规化。我们的大VGAN在各种分配情景中实现了最先进的零光性性表现,包括新语言、歌音、音乐声音、音乐和工具性文件的无影视环境。我们正在录制。