This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Cross-Modal Transfer in Visual and Haptic Face Recognition
October-December 2009 (vol. 2 no. 4)
pp. 236-240
Lisa Dopjans, Max Planck Institute for Biological Cybernetics, Tübingen
Christian Wallraven, Max Planck Institute for Biological Cybernetics, Tübingen
Heinrich H. Bülthoff, Max Planck Institute for Biological Cybernetics, Tübingen
We report four psychophysical experiments investigating cross-modal transfer in visual and haptic face recognition. We found surprisingly good haptic performance and cross-modal transfer for both modalities. Interestingly, transfer was asymmetric depending on which modality was learned first. These findings are discussed in relation to haptic object processing and face processing.

[1] I. Gauthier, T. Curran, K.M. Curby, and D. Collins, “Perceptual Interference Supports a Non-Modular Account of Face Processing,” Nature Neuroscience, vol. 6, no. 4, pp. 428-432, 2003.
[2] D. Maurer, R. Grand, and C. Mondloch, “The Many Faces of Configural Processing,” Trends Cognitive Sciences, vol. 6, no. 6, pp. 255-260, 2002.
[3] D.Y. Tsao, W.A. Freiwald, R.B.H. Tootell, and M.S. Livingstone, “A Cortical Region Consisting Entirely of Face-Selective Cells,” Science, vol. 311, no. 5761, pp. 670-674, 2006.
[4] E. McKone, N. Kanwisher, and B.C. Duchaine, “Can Generic Expertise Explain Special Processing for Faces?” Trends Cognitive Sciences, vol. 11, no. 1, pp. 8-15, 2007.
[5] R.D. Easton, A.J. Greene, and K. Srinivas, “Transfer between Vision and Haptics: Memory for 2d Patterns and 3d Objects,” Psychonomic Bull. and Rev., vol. 4, pp. 403-410, 1997.
[6] F.N. Newell, M.O. Ernst, B.S. Tjan, and H.H. Bülthoff, “Viewpoint Dependence in Visual and Haptic Object Recognition,” Psychological Science, vol. 12, no. 1, pp. 37-42, 2001.
[7] J.M. Reales and S. Ballesteros, “Implicit and Explicit Memory for Visual and Haptic Objects: Crossmodal Priming Depends on Structural Descriptions,” J. Experimental Psychology: Learning, Memory and Cognition, vol. 25, pp. 644-663, 1999.
[8] M.O. Ernst and H.H. Bülthoff, “Merging the Senses into a Robust Percept,” Trends in Cognitive Sciences, vol. 8, no. 4 pp. 162-169, 2004.
[9] V. Bruce and A. Young, “Understanding Face Recognition,” British J. Psychology, vol. 77, Pt 3, pp. 305-327, 1986.
[10] S.J. Lederman and R.L. Klatzky, “Haptic Classification of Common Objects: Knowledge-Driven Exploration,” Cognitive Psychology, vol. 22, no. 4, pp.421-459, 1990.
[11] A.R. Kilgour and S.J. Lederman, “Face Recognition by Hand,” Perception and Psychophysics, vol. 64, no. 3, pp. 339-352, 2002.
[12] S.J. Casey and F.N. Newell, “The Role of Long-Term and Short-Term Familiarity in Visual and Haptic Face Recognition,” Experimental Brain Research, vol. 166, nos. 3/4, pp. 583-591, 2005.
[13] S.J. Casey and F.N. Newell, “Are Representations of Unfamiliar Faces Independent of Encoding Modality?” Neuropsychologia, vol. 45, no. 3, pp.506-513, 2007.
[14] A.R. Kilgour and S.J. Lederman, “A Haptic Face-Inversion Effect,” Perception, vol. 35, no. 7, pp. 921-931, 2006.
[15] A.R. Kilgour, B. de Gelder, and S.J. Lederman, “Haptic Face Recognition and Prosopagnosia,” Neuropsychologia, vol. 42, no. 6, pp. 707-712, 2004.
[16] A.R. Kilgour, R. Kitada, P. Servos, T.W. James, and S.J. Lederman, “Haptic Face Identification Activates Ventral Occipital and Temporal Areas: An fMRI Study,” Brain and Cognition, vol. 59, no. 3, pp. 246-257, 2005.
[17] P. Pietrini, M.L. Furey, E. Ricciardi, M.I. Gobbini, W.-H.C. Wu, L. Cohen, M. Guazzelli, and J.V. Haxby, “Beyond Sensory Images: Object-Based Representation in the Human Ventral Pathway,” Proc. Nat'l Academy of Sciences USA, vol. 101, no. 15, pp. 5658-5663, 2004.
[18] N.F. Troje and H.H. Bülthoff, “Face Recognition Under Varying Poses: The Role of Texture and Shape,” Vision Research, vol. 36, no. 12, pp. 1761-1771, 1996.
[19] B. Jones, “The Developmental Significance of Cross-Modal Matching,” Intersensory Perception and Sensory Integration, pp. 109-136, Plenum, 1981.
[20] J.W. Tanaka and J.A. Sengco, “Features and Their Configuration in Face Recognition,” Memory and Cognition, vol. 25, no. 5, pp. 583-592, 1997.
[21] J.M. Loomis, R.L. Klatzky, and S.J. Lederman, “Similarity of Tactual and Visual Picture Recognition with Limited Field of View,” Perception, vol. 20, no. 2, pp. 167-177, 1991.
[22] R.L. Grand, C.J. Mondloch, D. Maurer, and H.P. Brent, “Expert Face Processing Requires Visual Input to the Right Hemisphere during Infancy,” Nature Neuroscience, vol. 6, no. 10, pp. 1108-1112, 2003.
[23] B. Molander and J. Garvill, “The Invariance of Asymmetric Crossmodal Transfer Effect,” Scandinavian J. Psychology, vol. 20, pp. 171-177, 1979.
[24] J.F. Norman, A.M. Clayton, H.F. Norman, and C.E. Crabtree, “Learning to Perceive Differences in Solid Shape through Vision and Touch,” Perception, vol. 37, no. 2, pp. 185-196, 2008.

Index Terms:
Cognition, human performance, perception and psychophysics.
Citation:
Lisa Dopjans, Christian Wallraven, Heinrich H. Bülthoff, "Cross-Modal Transfer in Visual and Haptic Face Recognition," IEEE Transactions on Haptics, vol. 2, no. 4, pp. 236-240, Oct.-Dec. 2009, doi:10.1109/TOH.2009.18
Usage of this product signifies your acceptance of the Terms of Use.