The Community for Technology Leaders
RSS Icon
Issue No.04 - October-December (2010 vol.3)
pp: 234-244
Massimiliano Di Luca , Max Planck Institute for Biological Cybernetics , Tübingen
Martin Buss , Technische Universität München, München
Roberta L. Klatzky , Carnegie Mellon University, Pittsburgh
The compliance of a material can be conveyed through mechanical interactions in a virtual environment and perceived through both visual and haptic cues. We investigated this basic aspect of perception. In two experiments, subjects performed compliance discriminations, and the mean perceptual estimate (PSE) and the perceptual standard deviation (proportional to JND) were derived from psychophysical functions. Experiment 1 supported a model in which each modality acted independently to produce a compliance estimate, and the two estimates were then integrated to produce an overall value. Experiment 2 tested three mathematical models of the integration process. The data ruled out exclusive reliance on the more reliable modality and stochastic selection of one modality. Instead, the results supported an integration process that constitutes a weighted summation of two random variables, which are defined by the single modality estimates. The model subsumes optimal fusion but provided valid predictions also if the weights were not optimal. Weights were optimal (i.e., minimized variance) when vision and haptic inputs were congruent, but not when they were incongruent.
Perception, haptic, vision, integration, optimal fusion, combination, human system interface, virtual reality.
Massimiliano Di Luca, Martin Buss, Roberta L. Klatzky, "Combination and Integration in the Perception of Visual-Haptic Compliance Information", IEEE Transactions on Haptics, vol.3, no. 4, pp. 234-244, October-December 2010, doi:10.1109/TOH.2010.9
[1] J. Driver and C. Spence, "Multisensory Perception: Beyond Modularity and Convergence," Current Biology, vol. 10, no. 13, pp. 731-735, 2000.
[2] D.W. Massaro, "Speechreading: Illusion or Window into Pattern Recognition," Trends in Cognitive Science, vol. 3, no. 8, pp. 310-317, 1999.
[3] B.E. Stein and M.A. Meredith, The Merging of the Senses. MIT Press, 1993.
[4] R.B. Welch and D.H. Warren, "Intersensory Interactions," Handbook of Perception and Human Performance: Sensory Processes and Perception, vol. 1, John Wiley & Sons, 1986.
[5] G.A. Calvert, M.J. Brammer, and S.D. Iversen, "Crossmodal Identification," Trends in Cognitive Sciences, vol. 2, no. 7, pp. 247-253, 1998.
[6] S. Guest and C. Spence, "What Role Does Multisensory Integration Play in the Visuotactile Perception of Texture?," Int'l J. Psychophysiology, vol. 50, pp. 63-80, 2003.
[7] M.O. Ernst and M.S. Banks, "Humans Integrate Visual and Haptic Information in a Statistically Optimal Fashion," Nature, vol. 415, pp. 429-433, 2002.
[8] J.M. Hillis, M.O. Ernst, M.S. Banks, and M.S. Landy, "Combining Sensory Information: Mandatory Fusion within, But Not between, Senses," Science, vol. 298, pp. 1627-1630, 2002.
[9] J.M. Hillis, S.J. Watt, M.S. Landy, and M.S. Banks, "Slant from Texture and Disparity Cues: Optimal Cue Combination," J. Vision, vol. 4, no. 13, pp. 1-24, 2004.
[10] D.C. Knill and J.A. Saunders, "Do Humans Optimally Integrate Stereo and Texture Information for Judgements of Surface Slant?," Vision Research, vol. 43, pp. 2539-2558, 2003.
[11] L.A. Jones and I.W. Hunter, "A Perceptual Analysis of Stiffness," Experimental Brain Research, vol. 79, pp. 150-156, 1990.
[12] H.Z. Tan, Pang, X.D. Pang, and N.I. Durlach, "Manual Resolution of Length, Force, and Compliance," Proc. Winter Ann. Meeting of the Am. Soc. of Mechanical Engineers Advances in Robotics, 1992.
[13] H.Z. Tan, N.I. Durlach, G.L. Beauregard, and M.A. Srinivasan, "Manual Discrimination of Compliance Using Active Pinch Grasp: The Roles of Force and Work Cues," Perception and Psychophysics, vol. 57, pp. 495-510, 1995.
[14] N. Dhruv and F. Tendick, "Frequency Dependence of Compliance Contrast Detection," Proc. ASME Dynamic Systems and Control Division Conf., 2000.
[15] R.H. LaMotte, "Softness Discrimination with a Tool," J. Neurophysiology, vol. 83, pp. 1777-1786, 2000.
[16] W. Bergmann-Tiest and A. Kappers, "Kinaesthetic and Cutaneous Contributions to the Perception of Compressibility," Proc. Int'l Conf. Haptics: Perception, Devices and Scenarios, pp. 255-264, 2008.
[17] M.A. Srinivasan, G.L. Beauregard, and D.L. Brock, "The Impact of Visual Information on the Haptic Perception of Stiffness in Virtual Environments," Proc. ASME Dynamics Systems and Control Division Conf., 1996.
[18] F. Freyberger, M. Kuschel, B. Färber, M. Buss, and B. Färber, "Visual-Haptic Perception of Compliance: Direct Matching of Visual and Haptic Information," Proc. IEEE Int'l Workshop Haptic Audio Visual Environments (HAVE) and Applications, 2007.
[19] M. Kuschel, F. Freyberger, M. Buss, B. Färber, and R.L. Klatzky, "Visual Haptic Perception of Compliance: Fusion of Visual and Haptic Information," Proc. Symp. Haptic Interfaces for Virtual Environments and Teleoperator Systems, 2008.
[20] V. Varadharajan, R.L. Klatzky, B. Unger, R. Swendson, and R. Hollis, "Haptic Rendering and Psychophysical Evaluation of a Virtual Three-Dimensional Helical Spring," Proc. 16th Symp. Haptic Interfaces for Virtual Environments and Teleoperator Systems, 2008.
[21] R. Teghtsoonian, "On the Exponents in Stevens' Law and the Constant in Ekman's Law," Psychological Rev., vol. 78, no. 1, pp. 71-80, 1971.
[22] B.R. Brewer, M. Fagan, R.L. Klatzky, and Y. Matsuoka, "Perceptual Limits for a Robotic Rehabilitation Environment Using Visual Feedback Distortion," IEEE Trans. Neural Systems and Rehabilitation Eng., vol. 13, no. 1, pp. 1-11, Mar. 2005.
[23] H.Z. Tan, M.A. Srinivasan, C.M. Reed, and N.I. Durlach, "Discrimination and Identification of Finger Joint-Angle Position Using Active Motion," ACM Trans. Applied Perception, vol. 4, no. 2, pp. 1-14, 2007.
[24] R. van Beers, A. Sittig, and J.J. Danier van der Gon, "The Precision of Proprioceptive Position Sense," Experimental Brain Research, vol. 11, pp. 367-377, 1998.
[25] R. van Beers, D. Wolpert, and P. Haggard, "When Feeling Is More Important Than Seeing in Sensorimotor Adaptation," Current Biology, vol. 12, pp. 834-837, 2002.
[26] E. Brenner and J.B.J. Smeets, "Fast Corrections of Movements with a Computer Mouse," Spatial Vision, vol. 16, pp. 364-376, 2003.
[27] F.A. Wichmann and N.J. Hill, "The Psychometric Function: I. Fitting, Sampling, and Goodness of Fit," Perception and Psychophysics, vol. 63, pp. 1293-1313, 2001.
[28] N.A. Macmillan and C.D. Creelman, Detection Theory—A User's Guide, second ed. Lawrence Erlbaum Assoc., Inc., 2005.
[29] M. Teghtsoonian and R. Teghtsoonian, "Seen and Felt Length," Psychonomic Science, vol. 3, pp. 465-466, 1965.
6 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool