Aural Proxies and Directionally-Varying Reverberation for Interactive Sound Propagation in Virtual Environments

• Published in: IEEE transactions on visualization and computer graphics Vol. 19; no. 4; pp. 567 - 575
• Main Authors: Antani, L., Manocha, D.
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.04.2013
• Subjects: Absorption; Acoustic Stimulation - methods; Algorithms; Auditory Perception - physiology; Computational modeling; Computer Graphics; directionally-varying reverberation; Face; Games; Geometry; Humans; Imaging, Three-Dimensional - methods; local approximate models; Mathematical model; real-time; Reverberation; Sound propagation; Sound Spectrography - methods; User-Computer Interface
• ISSN: 1077-2626; 1941-0506; 1941-0506
• DOI: 10.1109/TVCG.2013.27

We present an efficient algorithm to compute spatially-varying, direction-dependent artificial reverberation and reflection filters in large dynamic scenes for interactive sound propagation in virtual environments and video games. Our approach performs Monte Carlo integration of local visibility and depth functions to compute directionally-varying reverberation effects. The algorithm also uses a dynamically-generated rectangular aural proxy to efficiently model 2-4 orders of early reflections. These two techniques are combined to generate reflection and reverberation filters which vary with the direction of incidence at the listener. This combination leads to better sound source localization and immersion. The overall algorithm is efficient, easy to implement, and can handle moving sound sources, listeners, and dynamic scenes, with minimal storage overhead. We have integrated our approach with the audio rendering pipeline in Valve's Source game engine, and use it to generate realistic directional sound propagation effects in indoor and outdoor scenes in real-time. We demonstrate, through quantitative comparisons as well as evaluations, that our approach leads to enhanced, immersive multi-modal interaction.