Sound Synthesis and Evaluation of Interactive Footsteps and Environmental Sounds Rendering for Virtual Reality Applications
Issue No. 09 - September (2011 vol. 17)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TVCG.2011.30
Rolf Nordahl , Aalborg University Copenhagen, Ballerup
Stefania Serafin , Aalborg University Copenhagen, Ballerup
Luca Turchet , Aalborg University Copenhagen, Ballerup
We propose a system that affords real-time sound synthesis of footsteps on different materials. The system is based on microphones, which detect real footstep sounds from subjects, from which the ground reaction force (GRF) is estimated. Such GRF is used to control a sound synthesis engine based on physical models. Two experiments were conducted. In the first experiment, the ability of subjects to recognize the surface they were exposed to was assessed. In the second experiment, the sound synthesis engine was enhanced with environmental sounds. Results show that, in some conditions, adding a soundscape significantly improves the recognition of the simulated environment.
Sound and music computing, walking, surface simulation, soundscape rendering.
Rolf Nordahl, Stefania Serafin, Luca Turchet, "Sound Synthesis and Evaluation of Interactive Footsteps and Environmental Sounds Rendering for Virtual Reality Applications", IEEE Transactions on Visualization & Computer Graphics, vol. 17, no. , pp. 1234-1244, September 2011, doi:10.1109/TVCG.2011.30