The Community for Technology Leaders
RSS Icon
Issue No.01 - January-June (2008 vol.1)
pp: 27-38
Roberta L. Klatzky , CMU, Pittsburgh
E. Rennert-May , Queen's University, Kingston
J.H. Lee , Queen's University, Kingston
K. Ng , Queen's University, Kingston
Cheryl Hamilton , Queen's University, Kingston
Participants haptically (vs. visually) classified universal facial expressions of emotion (FEEs) depicted in simple 2D raised-line displays. Experiments 1 and 2 established that haptic classification was well above chance; face-inversion effects further indicated that the upright orientation was privileged. Experiment 2 added a third condition in which the normal configuration of the upright features was spatially scrambled. Results confirmed that configural processing played a critical role, since upright FEEs were classified more accurately and confidently than either scrambled or inverted FEEs, which did not differ. Because accuracy in both scrambled and inverted conditions was above chance, feature processing also played a role, as confirmed by commonalities across confusions for upright, inverted, and scrambled faces. Experiment 3 required participants to visually and haptically assign emotional valence (positive/negative) and magnitude to upright and inverted 2-D FEE displays. While emotional magnitude could be assigned using either modality, haptic presentation led to more variable valence judgments. We also documented a new face-inversion effect for emotional valence visually, but not haptically. These results suggest emotions can be interpreted from 2-D displays presented haptically as well as visually; however, emotional impact is judged more reliably by vision than by touch. Potential applications of this work are also considered.
Cognition, Education, Perception and psychophysics, Social communication
Roberta L. Klatzky, E. Rennert-May, J.H. Lee, K. Ng, Cheryl Hamilton, "Haptic Processing of Facial Expressions of Emotion in 2D Raised-Line Drawings", IEEE Transactions on Haptics, vol.1, no. 1, pp. 27-38, January-June 2008, doi:10.1109/TOH.2008.3
[1] A.J. Calder and A.W. Young, “Understanding the Recognition of Facial Identity and Facial Expression,” Nature Rev. Neuroscience, vol. 6, no. 8, pp. 641-651, 2005.
[2] M.J. Farah, J.W. Tanaka, and H.M. Drain, “What Causes the Face Inversion Effect?” J. Experimental Psychology: Human Perception and Performance, vol. 21, pp. 628-634, 1995.
[3] A. Freire, K. Lee, and L.A. Symons, “The Face-Inversion Effect as a Deficit in the Encoding of Configural Information: Direct Evidence,” Perception, vol. 29, no. 2, pp. 159-170, 2000.
[4] G.J. Hole, “Configurational Factors in the Perception of Unfamiliar Faces,” Perception, vol. 23, pp. 65-74, 1994.
[5] S.M. Collishaw and G.J. Hole, “Featural and Configurational Processes in the Recognition of Faces of Different Familiarity,” Perception, vol. 29, no. 8, pp. 893-909, 2000.
[6] D. Maurer, R. Le Grand, and C.J. Mondloch, “The Many Faces of Configural Processing,” Trends in Cognitive Sciences, vol. 6, pp. 255-260, 2002.
[7] R.K. Yin, “Looking at Upside-Down Faces,” J. Environmental Psychology, vol. 81, pp. 141-145, 1969.
[8] J. Sergent, “An Investigation into Component and Configural Processes Underlying Face Perception,” British J. Psychology, vol. 75, no. 2, pp. 221-242, 1984.
[9] L. Boutsen and G.W. Humphreys, “The Effect of Inversion on the Encoding of Normal and “Thatcherized” Faces,” Quarterly J. Experimental Psychology: Human Experimental Psychology, vol. 56A, pp. 955-975, 2003.
[10] A. Kilgour, B. De Gelder, and S.J. Lederman, “Haptic Face Recognition and Prosopagnosia,” Neuropsychologia, vol. 42, pp.707-712, 2004.
[11] A. Kilgour and S.J. Lederman, “Face Recognition by Hand,” Perception & Psychophysics, vol. 64, no. 3, pp. 339-352, 2002.
[12] A. Kilgour and S.J. Lederman, “A Haptic Face-Inversion Effect,” Perception, vol. 35, pp. 921-931, 2006.
[13] P. Pietrini, M.L. Furey, E. Ricciardi, M.I. Gobbini, W.H. Wu, L. Cohen, M. Guazzelli, and J.V. Haxby, “Beyond Sensory Images: Object-Based Representation in the Human Ventral Pathway,” Proc. Nat'l Academy of Sciences, vol. 101, pp. 5658-5663, 2004.
[14] S.J. Casey and F.N. Newell, “The Role of Long-Term and Short-Term Familiarity in Visual and Haptic Face Recognition,” Experimental Brain Research, vol. 166, nos. 3-4, pp. 583-591, Oct. 2005.
[15] S.J. Casey and F.N. Newell, “Are Representations of Unfamiliar Faces Independent of Encoding Modality?” Neuropsychologia, vol. 45, pp. 506-513, 2007.
[16] S.J. Lederman, R.L. Klatzky, A. Abramowicz, K. Salsman, R. Kitada, and C. Hamilton, “Haptic Recognition of Static and Dynamic Expressions of Emotion in the Live Face,” Psychological Science, vol. 18, no. 2, pp. 158-164, 2007.
[17] S. Lakatos and L.E. Marks, “Haptic Form Perception: Relative Salience of Local and Global Features,” Perception & Psychophysics, vol. 61, no. 5, pp. 895-908, 1999.
[18] P. Ekman et al., “Universals and Cultural Differences in the Judgment of Facial Expression of Emotions,” J. Personality and Social Psychology, vol. 53, pp. 712-717, 1987.
[19] A.J. Calder, A.W. Young, J. Keane, and M. Dean, “Configural Information in Facial Expression Perception,” J. Experimental Psychology: Human Perception and Performance, vol. 26, no. 20, pp.527-551, 2000.
[20] P. Ekman and W.V. Friesen, “Measuring Facial Movement,” Environmental Psychology & Nonverbal Behavior, vol. 1, no. 1, pp. 56-75, 1976.
[21] G.C. Prkachin, “The Effects of Orientation on Detection and Identification of Facial Expressions of Emotion,” British J. Psychology, vol. 94, pp. 45-62, 2003.
[22] M. Fallshore and J. Bartholow, “Recognition of Emotion from Inverted Schematic Drawings of Faces,” Perceptual and Motor Skills, vol. 96, pp. 236-244, 2003.
[23] M.P. Bryden, “Measuring Handedness with Questionnaires,” Neuropsychologia, vol. 15, no. 4-5, pp. 617-624, 1977.
[24] L.A. Jones and S.J. Lederman, Human Hand Function, chapter 4. Oxford Univ. Press, 2006.
[25] A.J. Calder, A.M. Burton, P. Miller, A.W. Young, and S. Akamatsu, “A Principal Component Analysis of Facial Expressions,” Vision Research, vol. 41, pp. 1179-1208.
[26] R.S. Woodworth and H. Schlosberg, Experimental Psychology, rev. ed., Holt, 1954.
[27] J.A. Russell, “A Circumplex Model of Affect,” J. Personality and Social Psychology, vol. 39, no. 6, pp. 1161-1178.
21 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool