The Community for Technology Leaders
RSS Icon
Issue No.02 - Second (2012 vol.5)
pp: 109-119
Joseph M. Romano , University of Pennsylvania, Philadelphia
Katherine J. Kuchenbecker , University of Pennsylvania, Philadelphia
Modern haptic interfaces are adept at conveying the large-scale shape of virtual objects, but they often provide unrealistic or no feedback when it comes to the microscopic details of surface texture. Direct texture-rendering challenges the state of the art in haptics because it requires a finely detailed model of the surface's properties, real-time dynamic simulation of complex interactions, and high-bandwidth haptic output to enable the user to feel the resulting contacts. This paper presents a new, fully realized solution for creating realistic virtual textures. Our system employs a sensorized handheld tool to capture the feel of a given texture, recording three-dimensional tool acceleration, tool position, and contact force over time. We reduce the three-dimensional acceleration signals to a perceptually equivalent one-dimensional signal, and then we use linear predictive coding to distill this raw haptic information into a database of frequency-domain texture models. Finally, we render these texture models in real time on a Wacom tablet using a stylus augmented with small voice coil actuators. The resulting virtual textures provide a compelling simulation of contact with the real surfaces, which we verify through a human subject study.
Haptic texture rendering, virtual reality, data-driven modeling, high-frequency vibrations.
Joseph M. Romano, Katherine J. Kuchenbecker, "Creating Realistic Virtual Textures from Contact Acceleration Data", IEEE Transactions on Haptics, vol.5, no. 2, pp. 109-119, Second 2012, doi:10.1109/TOH.2011.38
[1] S.J. Lederman, "Tactile Roughness of Grooved Surfaces: The Touching Process and Effects of Macro- and Microsurface Structure," Perception and Psychophysics, vol. 16, no. 2, pp. 385-395, 1974.
[2] G. Campion and V. Hayward, "Fundamental Limits in the Rendering of Virtual Haptic Textures," Proc. First Joint Eurohaptics Conf. Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 263-270, 2005.
[3] K.J. Kuchenbecker, J.P. Fiene, and G. Niemeyer, "Improving Contact Realism through Event-Based Haptic Feedback," IEEE Trans. Visualization and Computer Graphics, vol. 12, no. 2, pp. 219-230, Mar./Apr. 2006.
[4] M.C. Çavuşoğlu, D. Feygin, and F. Tendick, "A Critical Study of the Mechanical and Electrical Properties of the PHANToM Haptic Interface and Improvements for High-Performance Control," Presence: Teleoperators and Virtual Environments, vol. 11, pp. 555-568, 2002.
[5] M.A. Otaduy and M.C. Lin, "Rendering of Textured Objects," Haptic Rendering: Foundations, Algorithms, and Applications, M. Lin and M. Otaduy, eds., ch. 18, pp. 371-393, AK Peters, 2008.
[6] S.J. Lederman and R.L. Klatzky, "Extracting Object Properties through Haptic Exploration," Acta Psychologica, vol. 84, pp. 29-40, 1993.
[7] R. Klatzky and S.J. Lederman, "Perceiving Object Properties through a Rigid Link," Haptic Rendering: Foundations, Algorithms, and Applications, M.C. Lin and M. Otaduy, eds., ch. 1, pp. 7-19, AK Peters, 2008.
[8] S. Bensmaïa, M. Hollins, and J. Yau, "Vibrotactile Intensity and Frequency Information in the Pacinian System: A Psychophysical Model," Perception and Psychophysics, vol. 67, no. 5, pp. 828-841, 2005.
[9] T. Yoshioka, S.J. Bensmaïa, J.C. Craig, and S.S. Hsiao, "Texture Perception through Direct and Indirect Touch: An Analysis of Perceptual Space for Tactile Textures in Two Modes of Exploration," Somatosensory and Motor Research, vol. 24, pp. 53-70, 2007.
[10] K.-U. Kyung and J.-Y. Lee, "Ubi-Pen: A Haptic Interface with Texture and Vibrotactle Display," IEEE Computer Graphics and Applications, vol. 29, no. 1, pp. 56-64, Jan./Feb. 2009.
[11] J.C. Lee, P.H. Dietz, D. Leigh, W.S. Yerazunis, and S.E. Hudson, "Haptic Pen: A Tactile Feedback Stylus for Touch Screens," Proc. ACM Symp. User Interface Software and Technology, 2004.
[12] D.A. Kontarinis and R.D. Howe, "Tactile Display of Vibratory Information in Teleoperation and Virtual Environments," Presence: Teleoperators and Virtual Environments, vol. 4, pp. 387-402, 1995.
[13] S.A. Wall and W.S. Harwin, "Effects of Physical Bandwidth on Perception of Virtual Gratings," Proc. ASME Dynamics Systems and Control Division, vol. 69, pp. 1033-1039, 2000.
[14] H.-Y. Yao and V. Hayward, "A Tactile Enhancement Instrument for Minimally Invasive Surgery," Computer Aided Surgery, vol. 10, no. 4, pp. 233-239, 2004.
[15] H.-Y. Yao and V. Hayward, "A Network-Ready Multi-Lateral High Fidelity Haptic Probe," Proc. IEEE Symp. Haptic Interfaces for Virtual Environments and Teleoperator Systems (HAVE), pp. 81-82, 2006.
[16] H.-Y. Yao and V. Hayward, "Design and Analysis of a Recoil-Type Vibrotactile Transducer," J. Acoustic Soc. of Am., vol. 128, no. 2, pp. 619-627, 2010.
[17] C. Basdogan, C.-H. Ho, and M.A. Srinivasan, "A Ray-Based Haptic Rendering Technique for Displaying Shape and Texture of 3D Objects in Virtual Environments," Proc. ASME Dynamic Systems and Control Division, vol. 61, pp. 77-84, 1997.
[18] S. Choi and H.Z. Tan, "Toward Realistic Haptic Rendering of Surface Textures," IEEE Computer Graphics and Applications Special Issue on Haptic Rendering - Beyond Visual Computing, vol. 24, no. 2, pp. 40-47, Mar./Apr. 2004.
[19] M.A. Costa and M.R. Cutkosky, "Roughness Perception of Haptically Displayed Fractal Surfaces," Proc. ASME Dynamic Systems and Control Division, vol. 69, pp. 1073-1079, 2000.
[20] A. Crossan, J. Williamson, and R. Murray-Smith, "Haptic Granular Synthesis: Targeting, Visualisation and Texturing," Proc. Eighth Int'l Conf. Information Visualisation, pp. 527-532, 2004.
[21] S. Andrews and J. Lang, "Haptic Texturing Based on Real-World Samples," Proc. IEEE Int'l Workshop Haptic Audio Visual Environments and Their Applications (HAVE), 2007.
[22] S.A. Wall and W.S. Harwin, "Modelling of Surface Identifying Characteristics Using Fourier Series," Proc. ASME Dynamic Systems and Control Division, pp. 65-71, 1999.
[23] M. Minsky, O.-y. Ming, O. Steele, F.P. BrooksJr., and M. Behensky, "Feeling and Seeing: Issues in Force Display," SI3D '90: Proc. Symp. Interactive 3D Graphics, vol. 24, no. 2, pp. 235-241, 1990.
[24] M. Minsky and S.J. Lederman, "Simulated Haptic Textures: Roughness," Proc. ASME Dynamic Systems and Control Division, vol. 58, pp. 421-426, 1996.
[25] J. Siira and D.K. Pai, "Haptic Texturing - A Stochastic Approach," Proc. IEEE Int'l Conf. Robotics and Automation (ICRA), pp. 557-562, Apr. 1996.
[26] J.P. Fritz and K.E. Barner, "Stochastic Models for Haptic Texture," Proc. SPIE Int'l Symp. Intelligent Systems and Advanced Manufacturing, vol. 2901, no. 1, pp. 34-44, 1996.
[27] A.M. Okamura, R.J. Webster, J. Nolin, K.W. Johnson, and H. Jafry, "The Haptic Scissors: Cutting in Virtual Environments," Proc. IEEE Int'l Conf. Robotics and Automation (ICRA), pp. 828-833, Sept. 2003.
[28] K.E. MacLean, "The 'Haptic Camera': A Technique for Characterizing and Playing Back Haptic Properties of Real Environments," Proc. ASME Dynamic Systems and Control Division, vol. 58, pp. 459-467, 1996.
[29] D. Green and J.K. Salisbury, "Texture Sensing and Simulation Using the PHANToM: Towards Remote Sensing of Soil Properties," Proc. Second PHANToM Users Group Workshop (PUG), pp. 19-22, 1997.
[30] J.M. Romano, T. Yoshioka, and K.J. Kuchenbecker, "Automatic Filter Design for Synthesis of Haptic Textures from Recorded Acceleration Data," Proc. IEEE Int'l Conf. Robotics and Automation (ICRA), pp. 1815-1821, 2010.
[31] V.L. Guruswamy, J. Lang, and W.S. Lee, "Modelling of Haptic Vibration Textures with Infinite-Impulse-Response Filters," Proc. IEEE Int'l Workshop Haptic Audio Visual Environments and Games (HAVE), pp. 105-110, Nov. 2009.
[32] D.K. Pai, K. van del Doel, D.L. James, J. Lang, J.E. Lloyd, J.L. Richmond, and S.H. Yau, "Scanning Physical Interaction Behavior of 3D Objects," SIGGRAPH '01: Proc. 28th Ann. Conf. Computer Graphics and Interactive Techniques, pp. 87-96, 2001.
[33] W. McMahan, J.M. Romano, A.M.A. Rahuman, and K.J. Kuchenbecker, "High Frequency Acceleration Feedback Significantly Increases the Realism of Haptically Rendered Textured Surfaces," Proc. IEEE Haptics Symp., pp. 141-148, Mar. 2010.
[34] "The Linux Wacom Project," http:/linuxwacom.sourceforge. net/, Apr. 2010.
[35] J. Bell, S. Bolanowski, and M. Holmes, "The Structure and Function of Pacinian Corpuscles: A Review," Progress in Neurobiology, vol. 42, no. 1, pp. 79-128, 1994.
[36] N. Landin, J.M. Romano, W. McMahan, and K.J. Kuchenbecker, "Dimensional Reduction of High-Frequency Accelerations for Haptic Rendering," Proc. Int'l Conf. Haptics - Generating and Perceiving Tangible Sensations: Part II, pp. 79-86, July 2010.
[37] K.J. Kuchenbecker, J.M. Romano, and W. McMahan, "Haptography: Capturing and Recreating the Rich Feel of Real Surfaces," Robotics Research: the 14th Int'l Symp. (ISRR '09), C. Pradelier, R. Siegwart, and G. Hirzinger, eds., vol. 70, Springer Tracts in Advanced Robotics, pp. 245-260, 2011.
[38] "PortAudio - Cross-Platform Audio API," http:/www.portaudio. com/, Apr. 2010.
[39] W. McMahan and K.J. Kuchenbecker, "Haptic Display of Realistic Tool Contact via Dynamically Compensated Control of a Dedicated Actuator," Proc. IEEE/RSJ Int'l Conf. Intelligent Robots and Systems, pp. 3171-3177, 2009.
[40] H. Levitt, "Transformed Up-Down Methods in Psychoacoustics," The J. Acoustical Soc. of Am., vol. 49, pp. 467-477, 1971.
293 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool