The Community for Technology Leaders
2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (2014)
Munich, Germany
Sept. 10, 2014 to Sept. 12, 2014
ISBN: 978-1-4799-6184-9
pp: 53-61
Alok Meshram , Department of Computer Science, University of North Carolina, Chapel Hill
Ravish Mehra , Department of Computer Science, University of North Carolina, Chapel Hill
Hongsheng Yang , Department of Computer Science, University of North Carolina, Chapel Hill
Enrique Dunn , Department of Computer Science, University of North Carolina, Chapel Hill
Jan-Michael Franm , Department of Computer Science, University of North Carolina, Chapel Hill
Dinesh Manocha , Department of Computer Science, University of North Carolina, Chapel Hill
ABSTRACT
Accurate rendering of 3D spatial audio for interactive virtual auditory displays requires the use of personalized head-related transfer functions (HRTFs). We present a new approach to compute personalized HRTFs for any individual using a method that combines state-of-the-art image-based 3D modeling with an efficient numerical simulation pipeline. Our 3D modeling framework enables capture of the listener's head and torso using consumer-grade digital cameras to estimate a high-resolution non-parametric surface representation of the head, including the extended vicinity of the listener's ear. We leverage sparse structure from motion and dense surface reconstruction techniques to generate a 3D mesh. This mesh is used as input to a numeric sound propagation solver, which uses acoustic reciprocity and Kirchhoff surface integral representation to efficiently compute an individual's personalized HRTF. The overall computation takes tens of minutes on multi-core desktop machine. We have used our approach to compute the personalized HRTFs of few individuals, and we present our preliminary evaluation here. To the best of our knowledge, this is the first commodity technique that can be used to compute personalized HRTFs in a lab or home setting.
INDEX TERMS
Three-dimensional displays, Computational modeling, Ear, Numerical models, Pipelines, Solid modeling
CITATION
Alok Meshram, Ravish Mehra, Hongsheng Yang, Enrique Dunn, Jan-Michael Franm, Dinesh Manocha, "P-HRTF: Efficient personalized HRTF computation for high-fidelity spatial sound", 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), vol. 00, no. , pp. 53-61, 2014, doi:10.1109/ISMAR.2014.6948409
198 ms
(Ver 3.3 (11022016))