CSDL Home IEEE Transactions on Visualization & Computer Graphics 2011 vol.17 Issue No.09 - September
Sound Synthesis and Evaluation of Interactive Footsteps and Environmental Sounds Rendering for Virtual Reality Applications
Issue No.09 - September (2011 vol.17)
Rolf Nordahl , Aalborg University Copenhagen, Ballerup
Luca Turchet , Aalborg University Copenhagen, Ballerup
Stefania Serafin , Aalborg University Copenhagen, Ballerup
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TVCG.2011.30
We propose a system that affords real-time sound synthesis of footsteps on different materials. The system is based on microphones, which detect real footstep sounds from subjects, from which the ground reaction force (GRF) is estimated. Such GRF is used to control a sound synthesis engine based on physical models. Two experiments were conducted. In the first experiment, the ability of subjects to recognize the surface they were exposed to was assessed. In the second experiment, the sound synthesis engine was enhanced with environmental sounds. Results show that, in some conditions, adding a soundscape significantly improves the recognition of the simulated environment.
Sound and music computing, walking, surface simulation, soundscape rendering.
Rolf Nordahl, Luca Turchet, Stefania Serafin, "Sound Synthesis and Evaluation of Interactive Footsteps and Environmental Sounds Rendering for Virtual Reality Applications", IEEE Transactions on Visualization & Computer Graphics, vol.17, no. 9, pp. 1234-1244, September 2011, doi:10.1109/TVCG.2011.30