Mosaics and collages have been an integral part of art for decades. Particularly important in contemporary media art is the audio mosaic, in which an artist manually combines several audio sources in order to construct one single coherent sound, combining elements from disparate sources. Here we propose an algorithm to automatically create audio mosaics using the simulation-based inference paradigm. Our algorithm takes as input an audio file that one wishes to approximate, and a list of audio files one can use for approximation, finding a posterior distribution from which one can sample reconstructions of the original audio file, using the sources in an interpretable and disentangled manner. We validate our approach by creating an audio mosaic which reconstructs the sound of a traditional Korean funeral using 100 K-pop songs rearranged and overlapped.
翻译:数十年来,摩萨伊克和拼图一直是艺术的一个组成部分。在当代媒体艺术中,特别重要的是音频马赛克,艺术家手动将几个音源组合在一起,以构建一个单一连贯的音频,将不同来源的元素组合在一起。在这里,我们提出一个算法,利用模拟推论范式自动创建音频马赛克。我们的算法将人们希望接近的音频文档和可以用来近似的音频文档列表作为输入,找到一个后台分布,从中可以对原始音频文件的重建进行抽样,以可解释和分解的方式使用这些来源。我们通过创建一个音频马赛克来验证我们的方法,用100K-波曲重新组合和重叠的曲子重建韩国传统葬礼的声音。