The Community for Technology Leaders
RSS Icon
Issue No.03 - July-Sept. (2013 vol.6)
pp: 330-339
B. T. Gleeson , Dept. of Comput. Sci., Univ. of British Columbia, Vancouver, BC, Canada
W. R. Provancher , Dept. of Mech. Eng., Univ. of Utah, Salt Lake City, UT, USA
Haptic interfaces have the potential to enrich users' interactions with mobile devices and convey information without burdening the user's visual or auditory attention. Haptic stimuli with directional content, for example, navigational cues, may be difficult to use in handheld applications; the user's hand, where the cues are delivered, may not be aligned with the world, where the cues are to be interpreted. In such a case, the user would be required to mentally transform the stimuli between different reference frames. We examine the mental rotation of directional haptic stimuli in three experiments, investigating: 1) users' intuitive interpretation of rotated stimuli, 2) mental rotation of haptic stimuli about a single axis, and 3) rotation about multiple axes and the effects of specific hand poses and joint rotations. We conclude that directional haptic stimuli are suitable for use in mobile applications, although users do not naturally interpret rotated stimuli in any one universal way. We find evidence of cognitive processes involving the rotation of analog, spatial representations and discuss how our results fit into the larger body of mental rotation research. For small angles (e.g., less than 40 degree), these mental rotations come at little cost, but rotations with larger misalignment angles impact user performance. When considering the design of a handheld haptic device, our results indicate that hand pose must be carefully considered, as certain poses increase the difficulty of stimulus interpretation. Generally, all tested joint rotations impact task difficulty, but finger flexion and wrist rotation interact to greatly increase the cost of stimulus interpretation; such hand poses should be avoided when designing a haptic interface.
Haptic interfaces, Thumb, Skin, Visualization, Mobile handsets, Indexes,skin stretch, Human information processing, haptic I/O, mental rotation, tactile direction cues, haptics
B. T. Gleeson, W. R. Provancher, "Mental Rotation of Tactile Stimuli: Using Directional Haptic Cues in Mobile Devices", IEEE Transactions on Haptics, vol.6, no. 3, pp. 330-339, July-Sept. 2013, doi:10.1109/TOH.2013.5
[1] C.D. Wickens and J.G. Hollands, Engineering Psychology and Human Performance, third ed. Prentice-Hall, 2000.
[2] L.M. Parsons, "Serial Search and Comparison of Features of Imagined and Perceived Objects," Memory and Cognition, vol. 16, no. 1, pp. 23-35, 1988.
[3] R.N. Shepard and J. Metzler, "Mental Rotation of Three-Dimensional Objects," Science, vol. 171, no. 3972, pp. 701-703, 1971.
[4] L.M. Parsons, "Imagined Spatial Transformation of One's Body," J. Experimental Psychology, General, vol. 116, no. 2, pp. 172-191, 1987.
[5] L.A. Cooper and R.N. Shepard, "Mental Transformations in the Identification of Left and Right Hands," J. Experimental Psychology, Human Perception and Performance, vol. 104, no. 1, pp. 48-56, 1975.
[6] J.M. Zacks and P. Michelon, "Transformations of Visuospatial Images," Behavioral and Cognitive Neuroscience Revs., vol. 4, no. 2, pp. 96-118, 2005.
[7] J.M. Zacks, "Neuroimaging Studies of Mental Rotation: A Meta-Analysis and Review," J. Cognitive Neuroscience, vol. 20, no. 1, pp. 1-19, 2008.
[8] S.M. Kosslyn, G.J. DiGirolamo, W.L. Thompson, and N.M. Alpert, "Mental Rotation of Objects versus Hands: Neural Mechanisms Revealed by Positron Emission Tomography," Psychophysiology, vol. 35, no. 2, pp. 151-161, 1998.
[9] P.A. Carpenter and P. Eisenberg, "Mental Rotation and the Frame of Reference in Blind and Sighted Individuals," Perception and Psychophysics, vol. 23, no. 2, pp. 117-124, 1978.
[10] F. Rösler, B. Röder, M. Heil, and E. Hennighausen, "Topographic Differences of Slow Event-Related Brain Potentials in Blind and Sighted Adult Human Subjects during Haptic Mental Rotation," Cognitive Brain Research, vol. 1, no. 3, pp. 145-159, 1993.
[11] L.J. Hunt, M. Janssen, J. Dagostino, and B. Gruber, "Haptic Identification of Rotated Letters Using the Left or Right Hand," Perception and Motor Skills, vol. 68, no. 3, pp. 899-906, 1989.
[12] G.S. Marmor and L.A. Zaback, "Mental Rotation by the Blind: Does Mental Rotation Depend on Visual Imagery," J. Experimental Psychology: Human Perception and Performance, vol. 2, no. 4, pp. 515-521, 1976.
[13] S.C. Prather, J.R. Votaw, and K. Sathian, "Task-Specific Recruitment of Dorsal and Ventral Visual Areas during Tactile Perception," Neuropsychologia, vol. 42, no. 8, pp. 1079-1087, 2004.
[14] Y. Shimizu and B.J. Frost, "Effect of Orientation on Visual and Vibrotactile Letter Identification," Percept Motor Skills, vol. 71, no. 1, pp. 195-198, 1990.
[15] A. Dellantonio and F. Spagnolo, "Mental Rotation of Tactual Stimuli," Acta Psychologica, vol. 73, no. 3, pp. 245-257, 1990.
[16] R. Kitada, H.C. Dijkerman, G. Soo, and S.J. Lederman, "Representing Human Hands Haptically or Visually from First-Person versus Third-Person Perspectives," Perception, vol. 39, pp. 236-254, 2010.
[17] R. Volcic and A. Kappers, "Allocentric and Egocentric Reference frames in the Processing of Three-Dimensional Haptic Space," Experimental Brain Research, vol. 188, no. 2, pp. 199-213, 2008.
[18] R. Volcic, M. Wijntjes, E. Kool, and A. Kappers, "Cross-Modal Visuo-Haptic Mental Rotation: Comparing Objects between Senses," Experimental Brain Research, vol. 203, no. 3, pp. 621-627, 2010.
[19] R. Volcic, M.W.A. Wijntjes, and A.M.L. Kappers, "Haptic Mental Rotation Revisited: Multiple Reference Frame Dependence," Acta Psychologica, vol. 130, no. 3, pp. 251-259, 2009.
[20] S.C. Prather and K. Sathian, "Mental Rotation of Tactile Stimuli," Cognitive Brain Research, vol. 14, no. 1, pp. 91-98, 2002.
[21] C. Ware and R. Arsenault, "Frames of Reference in Virtual Object Rotation," Proc. Symp. Applied Perception in Graphics and Visualization, 2004.
[22] H.Z. Tan and A. Pentland, "Tactual Displays for Wearable Computing," Personal and Ubiquitous Computing, vol. 1, no. 4, pp. 225-230, 1997.
[23] J. Van Erp, "Presenting Directions with a Vibrotactile Torso Display," Ergonomics, vol. 48, no. 3, pp. 302-313, 2005.
[24] H.Z. Tan, R. Gray, J.J. Young, and R. Traylor, "A Haptic Back Display for Attentional and Directional Cueing," Haptics-e, vol. 3, article 1, 2003.
[25] D. Kern, P. Marshall, E. Hornecker, Y. Rogers, and A. Schmidt, "Enhancing Navigation Information with Tactile Output Embedded into the Steering Wheel," Proc. Int'l Conf. Pervasive Computing, 2009.
[26] K.N. Winfree, J. Gewirtz, T. Mather, J. Fiene, and K.J. Kuchenbecker, "A High Fidelity Ungrounded Torque Feedback Device: The iTorqU 2.0," Proc. Third Joint World Haptics EuroHaptics Conf. and Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems (World Haptics '09), pp. 261-266, 2009.
[27] N.G. Tsagarakis, T. Horne, and D.G. Caldwell, "Slip Aestheasis: A Portable 2D Slip/Skin Stretch Display for the Fingertip," Proc. Eurohaptics, 2005.
[28] Q. Wang and V. Hayward, "Biomechanically Optimized Distributed Tactile Transducer Based on Lateral Skin Deformation," Int'l J. Robotics Research, vol. 29, pp. 323-335, 2009.
[29] R.J. WebsterIII, T.E. Murphy, L.N. Verner, and A.M. Okamura, "A Novel Two-Dimensional Tactile Slip Display: Design, Kinematics and Perceptual Experiments," Trans. Applied Perception, vol. 2, no. 2, pp. 150-165, 2005.
[30] B.T. Gleeson, S. Horschel, and W. Provancher, "Perception of Direction for Applied Tangential Skin Displacement: Effects of Speed, Displacement and Repetition," IEEE Trans. Haptics, vol. 3, no. 3, pp. 177-188, July-Sept. 2010.
[31] B.T. Gleeson, S. Horschel, and W. Provancher, "Design of a Fingertip-Mounted Tactile Display with Tangential Skin Displacement Feedback," IEEE Trans. Haptics, vol. 3, no. 4, pp. 297-301, Oct.-Dec. 2010.
[32] D.H. Brainard, "The Psychophysics Toolbox," Spatial Vision, vol. 10, pp. 433-436, 1997.
[33] A.M.L. Kappers and J.J. Koenderink, "Haptic Perception of Spatial Relations," Perception, vol. 28, no. 6, pp. 781-795, 1999.
[34] L.M. Parsons, "Temporal and Kinematic Properties of Motor Behavior Reflected in Mentally Simulated Action," J. Experimental Psychology: Human Perception and Performance, vol. 20, no. 4, pp. 709-730, 1994.
[35] L.M. Parsons, "Imagined Spatial Transformations of One's Hands and Feet," Cognitive Psychology, vol. 19, no. 2, pp. 178-241, 1987.
[36] L.M. Parsons, "Inability to Reason about an Object's Orientation Using an Axis and Angle of Rotation," J. Experimental Psychology: Human Perception and Performance, vol. 21, no. 6, pp. 1259-1277, 1995.
29 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool