The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.04 - April (2013 vol.19)
pp: 557-566
ABSTRACT
Accurately modeling the intrinsic material-dependent damping property for interactive sound rendering is a challenging problem. The Rayleigh damping model is commonly regarded as an adequate engineering model for interactive sound synthesis in virtual environment applications, but this assumption has never been rigorously analyzed. In this paper, we conduct a formal evaluation of this model. Our goal is to determine if auditory perception of material under Rayleigh damping assumption is 'geometryinvariant', i.e. if this approximation model is transferable across different shapes and sizes. First, audio recordings of same-material objects in various shapes and sizes are analyzed to determine if they can be approximated by the Rayleigh damping model with a single set of parameters. Next, we design and conduct a series of psychoacoustic experiments, in subjects evaluate if audio clips synthesized using the Rayleigh damping model are from the same material, when we alter the material, shape, and size parameters. Through both quantitative and qualitative evaluation, we show that the acoustic properties of the Rayleigh damping model for a single material is generally preserved across different geometries of objects consisting of homogeneous materials and is therefore a suitable, geometry-invariant sound model. Our study results also show that consistent with prior crossmodal expectations, visual perception of geometry can affect the auditory perception of materials. These findings facilitate the wide adoption of Rayleigh damping for interactive auditory systems and enable reuse of material parameters under this approximation model across different shapes and sizes, without laborious per-object parameter tuning.
INDEX TERMS
Damping, Shape, Psychoacoustic models, Geometry, Glass, Analytical models,human perception of material., Sound synthesis
CITATION
Zhimin Ren, Hengchin Yeh, R. Klatzky, M. C. Lin, "Auditory Perception of Geometry-Invariant Material Properties", IEEE Transactions on Visualization & Computer Graphics, vol.19, no. 4, pp. 557-566, April 2013, doi:10.1109/TVCG.2013.26
REFERENCES
[1] S. Adhikari and J. Woodhouse., Identification of damping: Part 1, viscous damping. Journal of Sound and Vibration, 243(1): 43-61, 2001.
[2] J.-M. Adrien., Representations of musical signals. chapter The missing link: modal synthesis, pages 269-298. MIT Press, Cambridge, MA, USA, 1991.
[3] N. Bonneel, C. Suied, I. Viaud-Delmon,, and G. Drettakis., Bimodal perception of audio-visual material properties for virtual environments. ACM Transactions on Applied Perception (TAP), 7(1):1, 2010.
[4] P. R. Cook., Real Sound Synthesis for Interactive Applications. A. K. Peters, Ltd., Natick, MA, USA, 2002.
[5] R. Corbett,K. van den Doel,J. E. Lloyd,, and W. Heidrich., Timbrefields: 3d interactive sound models for real-time audio. Presence: Teleoperators and Virtual Environments, 16(6): 643-654, 2007.
[6] K. Doel and D. Pai., The sounds of physical shapes. Presence, 7(4): 382-395, 1998.
[7] W. Gaver., Everyday listening and auditory icons. PhD thesis, University of California, San Diego, 1988.
[8] B. Giordano and S. Mcadams., Material identification of real impact sounds: Effects of size variation in steel, glass, wood, and plexiglass plates. The Journal of the Acoustical Society of America, 119:1171, 2006.
[9] D. Howell., Statistical methods for psychology. Wadsworth Pub Co, 2009.
[10] D. L. James,J. Barbič,, and D. K. Pai., Precomputed acoustic transfer: output-sensitive, accurate sound generation for geometrically complex vibration sources. In ACM SIGGRAPH 2006 Papers, SIGGRAPH '06, pages 987-995, New York, NY, USA, 2006. ACM.
[11] R. Klatzky, D. Pai,, and E. Krotkov., Perception of material from contact sounds. Presence: Teleoperators & Virtual Environments, 9(4): 399-410, 2000.
[12] E. Krotkov, R. Klatzky, and N. Zumel., Analysis and synthesis of the sounds of impact based on shape-invariant properties of materials. In Pattern Recognition, 1996., Proceedings of the 13th International Conference on, volume 1, pages 115-119. IEEE, 1996.
[13] E. Krotkov, R. Klatzky,, and N. Zumel., Robotic perception of material: Experiments with shape-invariant acoustic measures of material type. Experimental Robotics IV, pages 204-211, 1997.
[14] S. McAdams, A. Chaigne,, and V. Roussarie., The psychomechanics of simulated sound sources: Material properties of impacted bars. Journal of The Acoustical Society of America, 115, 2004.
[15] R. Nordahl, S. Serafin,, and L. Turchet., Sound synthesis and evaluation of interactive footsteps for virtual reality applications. In Virtual Reality Conference (VR), 2010 IEEE, pages 147-153, march 2010.
[16] J. O'Brien,C. Shen,, and C. Gatchalian., Synthesizing sounds from rigid-body simulations. In Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation, pages 175–181. ACM, 2002.
[17] N. Raghuvanshi and M. C. Lin., Interactive sound synthesis for large scale environments. In Proceedings of the 2006 symposium on Interactive 3D graphics and games, I3D '06, pages 101-108, New York, NY, USA, 2006. ACM.
[18] B. Rayleigh., The theory of sound, volume 2. Reprinted: Dover, New York. 1945.
[19] Z. Ren, R. Mehra, J. Coposky,, and M. C. Lin., Tabletop ensemble: touch-enabled virtual percussion instruments. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D '12, pages 7-14, New York, NY, USA, 2012. ACM.
[20] Z. Ren, H. Yeh,, and M. Lin., Synthesizing Contact Sounds between textured Models. In Virtual Reality Conference (VR), 2010 IEEE, pages 139-146. IEEE, 2010.
[21] Z. Ren, H. Yeh,, and M. C. Lin., Example-Guided Physically Based Modal Sound Synthesis. ACM Transactions on Graphics, 32(1), Jan. 2013.
[22] A. Shabana., Vibration of discrete and continuous systems. Springer Verlag, 1997.
[23] R. Steel and J. Torrie., Principles and procedures of statistics: with special reference to the biological sciences. McGraw-Hill Companies, 1960.
[24] T. Takala and J. Hahn., Sound rendering. In ACM SIGGRAPH Computer Graphics, volume 26, pages 211-220. ACM, 1992.
[25] K. van den Doel,P. Kry,, and D. Pai., FoleyAutomatic: physically-based sound effects for interactive simulation and animation. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques, pages 537-544. ACM New York, NY, USA, 2001.
[26] P. Vangorp, J. Laurijssen,, and P. Dutré., The influence of shape on the perception of material reflectance. In ACM SIGGRAPH 2007 papers, SIGGRAPH '07, New York, NY, USA, 2007. ACM.
[27] R. Wildes and W. Richards., Recovering material properties from sound. Natural computation, pages 356-363, 1988.
[28] C. Zheng and D. L. James., Rigid-body fracture sound with precomputed soundbanks. In ACM SIGGRAPH 2010 papers, SIGGRAPH '10, pages 69:1-69:13, New York, NY, USA, 2010. ACM.
59 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool