Sound, as a crucial sensory channel, plays a vital role in improving the reality and immersiveness of a virtual environment, following only vision in importance. Sound can provide important clues such as sound directionality and spatial size. This paper gives a broad overview of research works on sound simulation in virtual reality, games, multimedia, computer-aided design. We first survey various sound synthesis methods, including harmonic synthesis, texture synthesis, spectral analysis, and physics-based synthesis. Then, we summarize popular sound propagation techniques, namely wave-based methods, geometric-based methods, and hybrid methods. Next, the sound rendering methods are reviewed. We further demonstrate the latest deep learning based sound simulation approaches. Finally, we point to some future directions of this field. To the best of our knowledge, this is the first attempt to provide a comprehensive summary of sound research in the field of computer graphics.
翻译:作为一个关键的感官渠道,作为一个关键的感官渠道,在改善虚拟环境的现实和隐蔽性方面发挥着关键作用,仅凭着重要的眼光。声音可以提供重要线索,例如稳健的方向性和空间大小。本文对虚拟现实、游戏、多媒体、计算机辅助设计中健全的模拟的研究工作作了广泛的概述。我们首先调查各种健全的合成方法,包括口音合成、质谱合成、光谱分析和物理合成。然后,我们总结流行的声学传播技术,即波测法、几何法和混合法。接着,对音学方法进行了审查。我们进一步展示了最新的深层学习的声学模拟方法。最后,我们指出这一领域今后的一些方向。我们最了解的是,这是首次尝试提供计算机图形领域健全研究的全面摘要。