Issue No.03 - March (2011 vol.17)
pp: 380-391
Jochen Lang , University of Ottawa, Ottawa
Sheldon Andrews , McGill University, Montreal
Haptic texture represents the fine-grained attributes of an object's surface and is related to physical characteristics such as roughness and stiffness. We introduce an interactive and mobile scanning system for the acquisition and synthesis of haptic textures that consists of a visually tracked handheld touch probe. The most novel aspect of our work is an estimation method for the contact stiffness of an object based solely on the acceleration and forces measured during stroking of its surface with the handheld probe. We establish an experimental relationship between the estimated stiffness and the contact stiffness observed during compression. We also measure the height-displacement profile of an object's surface enabling us to generate haptic textures. We show an example of mapping the textures on to a coarse surface mesh obtained with an image-based technique, but the textures may also be combined with coarse surface meshes obtained by manual modeling.
Haptics, texture, contact stiffness, measurement-based modeling.
Jochen Lang, Sheldon Andrews, "Measurement-Based Modeling of Contact Forces and Textures for Haptic Rendering", IEEE Transactions on Visualization & Computer Graphics, vol.17, no. 3, pp. 380-391, March 2011, doi:10.1109/TVCG.2010.52
[1] V. Hayward, O.R. Astley, M. Cruz-Hernandez, D. Grant, and G. Robles-De-La-Torre, "Haptic Interfaces and Devices," Sensor Rev., vol. 24, pp. 16-29, Feb. 2004.
[2] R.L. Klatzky, J.M. Loomis, S.J. Lederman, H. Wake, and N. Fujita, "Haptic Identification of Objects and Their Depictions," Perception & Psychophysics, vol. 54, no. 2, pp. 170-178, 1993.
[3] D. Pai, J. Lang, J. Lloyd, and R. Woodham, "ACME: A Telerobotic Active Measurement Facility," Experimental Robotics VI, vol. 250, pp. 391-400, 2000.
[4] D.K. Pai, K. van den Doel, D.L. James, J. Lang, J.E. Lloyd, J.L. Richmond, and S.H. Yau, "Scanning Physical Interaction Behavior of 3D Objects," Proc. Ann. Conf. Computer Graphics and Interactive Techniques, pp. 87-96, Aug. 2001.
[5] F. Bernardini and H. Rushmeier, "The 3D Model Acquisition Pipeline," Computer Graphics Forum, vol. 21, no. 2, pp. 149-172, 2002.
[6] S. Andrews and J. Lang, "Interactive Scanning of Haptic Textures and Surface Compliance," Proc. Sixth Int'l Conf. 3D Digital Imaging and Modeling (3DIM), 2007.
[7] S. Andrews and J. Lang, "Haptic Texturing Based on Real-World Samples," Proc. IEEE Int'l Workshop Haptic, Audio and Visual Environments and Games, pp. 142-147, Oct. 2007.
[8] M. Hollins, R. Faldowski, S. Rao, and F. Young, "Perceptual Dimensions of Tactile Surface Texture: A Multidimensional Scaling Analysis," Perception and Psychophysics, vol. 54, no. 6, pp. 697-705, 1993.
[9] W.M. Bergmann Tiest and A.M.L. Kappers, "Analysis of Haptic Perception of Materials by Multidimensional Scaling and Physical Measurements of Roughness and Compressibility," Acta Psychologica, vol. 121, no. 1, pp. 1-20, 2006.
[10] R.L. Klatzky and S.J. Lederman, "Tactile Roughness Perception with a Rigid Link Interposed between Skin and Surface," Perception and Psychophysics, vol. 61, no. 4, pp. 591-607, 1999.
[11] S.J. Lederman, R.L. Klatzky, C.L. Hamilton, and G.I. Ramsay, "Perceiving Roughness via a Rigid Probe: Psychophysical Effects of Exploration Speed and Mode of Touch," Haptics-e J., vol. 1, no. 1, 1999.
[12] H. Pongrac, "Vibrotactile Perception: Differential Effect of Frequency, Amplitude, and Acceleration," Proc. IEEE Int'l Workshop Haptic Audio Visual Environments and Their Applications, pp. 72-77, 2006.
[13] K. Johnson, "Neural Basis of Haptic Perception," Stevens' Handbook of Experimental Psychology, Vol. 1: Sensation and Perception, pp. 537-583, John Wiley, 2002.
[14] G. Campion and V. Hayward, "Fundamental Limits in the Rendering of Virtual Haptic Textures," Proc. First Joint Eurohaptics Conf. and Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2005.
[15] A.M. Okamura, J.T. Dennerlein, and M.R. Cutkosky, "Reality-Based Models for Vibration Feedback in Virtual Environments," IEEE/ASME Trans. Mechatronics, vol. 6, no. 3, pp. 245-252, Sept. 2001.
[16] H.Y. Yao, V. Hayward, and R.E. Ellis, "A Tactile Enhancement Instrument for Minimally Invasive Surgery," Computer Aided Surgery, vol. 10, pp. 233-239, May 2005.
[17] R. Höver, G. Kósa, G. Székely, and M. Harders, "Data-Driven Haptic Rendering—from Viscous Fluids to Visco-Elastic Solids," IEEE Trans. Haptics, vol. 2, no. 1, pp. 15-27, Jan.-Mar. 2009.
[18] S. Rusinkiewicz, O. Hall-Holt, and M. Levoy, "Real-Time 3D Model Acquisition," ACM Trans. Graphics, vol. 21, no. 3, pp. 438-446, July 2002.
[19] J.-Y. Bouguet and P. Perona, "3D Photography on Your Desk," Proc. Int'l Conf. Computer Vision, pp. 43-50, Jan. 1998.
[20] B. Bickel, M. Bächer, M.A. Otaduy, W. Matusik, H. Pfister, and M.H. Gross, "Capture and Modeling of Non-Linear Heterogeneous Soft Tissue," ACM Trans. Graphics, vol. 28, no. 3, 2009.
[21] M.A. Costa and M.R. Cutkosky, "Roughness Perception of Haptically Displayed Fractal Surfaces," Proc. Conf. ASME Dynamic Systems and Control Division, vol. 69, no. 2, pp. 1073-1079, 2000.
[22] S.A. Wall and W.S. Harwin, "Modelling of Surface Identifying Characteristics Using Fourier Series," Proc. Conf. ASME Dynamic Systems and Control Division, vol. 69, no. 2, pp. 65-71, 1999.
[23] D.K. Pai and P. Rizun, "The WHaT: A Wireless Haptic Texture Sensor," Proc. 11th Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003.
[24] R.S. Fearing, "Tactile Sensing Mechanisms," Int'l J. Robotics Research, vol. 9, no. 3, pp. 3-23, 1990.
[25] V. Maheshwari and R.F. Saraf, "High-Resolution Thin-Film Device to Sense Texture by Touch," Science, vol. 312, pp. 1501-1504, June 2006.
[26] T.C. Aysal and K.E. Barner, "Stochastic and Deterministic Models for Haptic Pseudo Textures," Proc. 10th Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 469-476, Mar. 2006.
[27] C. Basdogan, C. Ho, and M.A. Srinivasan, "A Ray-Based Haptic Rendering Technique for Displaying Shape and Texture of 3D Objects in Virtual Environment," Proc. Conf. ASME Dynamic Systems and Control Division, pp. 77-84, 1997.
[28] M. Minsky, O.-Y. Ming, O. SteeleJr., F.P. Brooks, and M. Behensky, "Feeling and Seeing: Issues in Force Display," Proc. Symp. Interactive 3D Graphics, pp. 235-241, 1990.
[29] J.F. Blinn, "Simulation of Wrinkled Surfaces," SIGGRAPH Computer Graphics, vol. 12, no. 3, pp. 286-292, 1978.
[30] M.A. Otaduy and M.C. Lin, "A Perceptually-Inspired Force Model for Haptic Texture Rendering," Proc. Symp. Applied Perception in Graphics and Visualization, pp. 123-126, 2004.
[31] M.A. Otaduy, N. Jain, A. Sud, and M.C. Lin, "Haptic Display of Interaction between Textured Models," Proc. IEEE Visualization Conf., pp. 297-304, 2004.
[32] J. Shopf and M. Olano, "Procedural Haptic Texture," Proc. 19th ACM Symp. User Interface Software and Technology (UIST '06), pp. 179-186, 2006.
[33] R. Cortes and S. Raghavachary, The RenderMan Shading Language Guide. Course Technology PTR, Mar. 2007.
[34] S. Andrews, "Measurement-Based Modeling of Contact Forces and Textures for Haptic Rendering," MASc thesis, Univ. of Ottawa, 2007.
[35] M. Vergauwen and L. Van Gool, "Web-Based 3d Reconstruction Service," Machine Vision and Applications, vol. 17, no. 6, pp. 411-426, 2006.
[36] D. Wagner and D. Schmalstieg, "ARToolKitPlus for Pose Tracking on Mobile Devices," Proc. Computer Vision Winter Workshop, Feb. 2007.
[37] M. Fiala, "ARTag Revision 1, a Fiducial Marker System Using Digital Techniques," Technical Report NRC/ERB1117, Nat'l Research Council of Canada, 2004.
[38] G. Schweighofer and A. Pinz, "Robust Pose Estimation from a Planar Target," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 12, pp. 2024-2030, Dec. 2000.
[39] C.P. Lu, G.D. Hager, and E. Mjolsness, "Fast and Globally Convergent Pose Estimation from Video Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 6, pp. 610-622, June 2000.
[40] R.E. Kalman, "A New Approach to Linear Filtering and Prediction Problems," Trans. ASME—J. Basic Eng., vol. 82, no. Series D, pp. 35-45, 1960.
[41] N. McKay and P. Besl, "A Method for Registration of 3d Shapes," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 239-256, Feb. 1992.
[42] P. Cignoni, M. Corsini, and G. Ranzuglia, "MeshLab: An Open-Source 3D Mesh Processing System," ERCIM News, no. 73, pp. 45-46, Apr. 2008.
[43] K. Shoemake, "Animating Rotation with Quaternion Curves," Proc. Ann. Conf. Computer Graphics and Interactive Techniques, pp. 245-254, July 1985.
[44] L. Verlet, "Computer Experiments on Classical Fluids," Physical Rev., vol. 159, no. 1, p. 98, July 1967.
[45] W.H. Press, S.A. Teukolsky, W.T. Vetterling, and B.P. Flannery, Numerical Recipes in C: The Art of Scientific Computing, second ed. Cambridge Univ. Press, 1992.
[46] M. Mahvash and V. Hayward, "High-Fidelity Haptic Synthesis of Contact with Deformable Bodies," IEEE Computer Graphics and Applications, vol. 24, no. 2, pp. 48-55, Mar. 2004.
[47] Konica Minolta Holdings, "Non-Contact 3d Digitizer Vivid 910/vi-910," June 2007.
[48] W.C. Oliver and G.M. Pharr, "An Improved Technique for Determining Hardness and Elastic Modulus Using Load and Displacement Sensing Indentation Experiments," J. Materials Research, vol. 7, no. 6, pp. 1564-1583, 1992.
[49] B.J. Briscoe, K.S. Sebastian, and M.J. Adams, "The Effect of Indenter Geometry on the Elastic Response to Indentation," J. Physics D: Applied Physics, vol. 27, no. 6, pp. 1156-1162, 1994.
[50] J. Siira and D.K. Pai, "Haptic Rendering: A Stochastic Approach," Proc. IEEE Int'l Conf. Robotics and Automation, pp. 557-562, 1996.