This Article 
 Bibliographic References 
 Add to: 
Detectability and Perceptual Consequences of Delayed Feedback in a Vibrotactile Texture Display
April-June 2009 (vol. 2 no. 2)
pp. 73-84
Shogo Okamoto, Tohoku University, Sendai
Masashi Konyo, Tohoku University, Sendai
Satoshi Saga, Tohoku University, Sendai
Satoshi Tadokoro, Tohoku University, Sendai
This study estimated the maximum allowable system latency for haptic displays that produce tactile stimuli in response to the hand movements of users. In Experiment 1, two types of detection thresholds were estimated for the time delay of stimuli through psychophysical experiments involving 13 participants. One was a threshold for the users to notice the existence of a time delay. The other was a threshold for the users to experience changes in the perceived textures in comparison with stimuli with no time delay. The estimated thresholds were approximately 60 and 40 ms, respectively. In interviews, the participants reported that they experienced various types of subjective changes due to the time delay. In Experiment 2, the types of subjective sensations that might be altered by the time delay were investigated. The time delays were controlled based on the acceleration of the hand motions of the participants. The participants evaluated the differences in the perceived textures between the stimuli with a controlled time delay and ones with no delay. The results indicated that the participants associated the time-delayed stimuli with changes in mechanical parameters such as kinetic friction coefficient in addition to changes in the perceived roughness of the textures.

[1] M. Konyo, A. Yoshida, S. Tadokoro, and N. Saiwaki, “A Tactile Synthesis Method Using Multiple Frequency Vibration for Representing Virtual Touch,” Proc. IEEE/RSJ 2005 Int'l Conf. Intelligent Robots and Systems, pp. 1121-1127, 2005.
[2] T. Nara, M. Takasaki, T. Maeda, T. Higuchi, S. Ando, and S. Tachi, “Surface Acoustic Wave Tactile Display,” IEEE Computer Graphics and Applications, vol. 21, no. 6, pp. 56-63, Nov./Dec. 2001.
[3] V. Levesque, J. Pasquero, V. Hayward, and M. Legault, “Display of Virtual Braille Dots by Lateral Skin Deformation: Feasibility Study,” ACM Trans. Applied Perception, vol. 2, no. 2, pp. 132-149, 2005.
[4] L. Winfield, J. Glassmire, J.E. Colgate, and M. Peshkin, “T-PaD: Tactile Pattern Display through Variable Friction Reduction,” Proc. Second Joint EuroHaptics Conf. and Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 421-426, 2007.
[5] R.D. Howe, W.J. Peine, D.A. Kontarinis, and J.S. Son, “Remote Palpation Technology,” IEEE Eng. in Medicine and Biology, vol. 14, no. 3, pp. 318-323, May/June 1995.
[6] J.T. Dennerlein, P.A. Millman, and R.D. Howe, “Vibrotactile Feedback for Industrial Telemanipulators,” Proc. Sixth Ann. Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, ASME Int'l Mechanical Eng. Congress and Exposition, vol. 61, pp.189-195, 1997.
[7] A. Yamamoto, S. Nagasawa, H. Yamamoto, and T. Higuchi, “Electrostatic Tactile Display with Thin Film Slider and Its Application to Tactile Telepresentation Systems,” IEEE Trans. Visualization and Computer Graphics, vol. 12, no. 2, pp. 168-177, Mar./Apr. 2006.
[8] K.J. Kuchenbecker and G. Niemeyer, “Improving Telerobotic Touch via High-Frequency Acceleration Matching,” Proc. 2006 IEEE Int'l Conf. Robotics and Automation, pp. 3893-3898, 2006.
[9] S. Okamoto, M. Konyo, T. Maeno, and S. Tadokoro, “Roughness Feeling Telepresence System with Communication Time-delay,” Proc. Second Joint EuroHaptics Conf. and Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp.595-596, 2007.
[10] I.J. Hirsh and C.E. Sherrick, “Perceived Order in Different Sense Modalities,” J. Experimental Psychology, vol. 62, no. 5, pp. 423-432, 1961.
[11] G.A. Gescheider, “Auditory and Cutaneous Temporal Resolution of Successive Brief Stimuli,” J. Experimental Psychology, vol. 75, no. 4, pp. 570-572, 1967.
[12] J.C. Craig, “Temporal Order and Tactile Patterns,” Perception & Psychophysics, vol. 47, no. 1, pp. 22-34, 1990.
[13] L.E. Marks, “Electrocutaneous Stimulation III. The Perception of Temporal Order,” Perception & Psychophysics, vol. 32, no. 6, pp.537-541, 1982.
[14] C.L. Van Doren, G.A. Gescheider, and R.T. Verrillo, “Vibrotactile Temporal Gap Detection as a Function of Age,” J. Acoustical Soc. America, vol. 87, no. 5, pp. 2201-2206, 1990.
[15] D.J. Levitin, K. MacLean, M. Mathews, and L. Chu, “The Perception of Cross-Modal Simultaneity,” Proc. Third Int'l Conf. Computing Anticipatory Systems, pp. 323-329, 2000.
[16] B.D. Adelstein, D.R. Begault, M.R. Anderson, and E.M. Wenzel, “Sensitivity to Haptic-Audio Asynchrony,” Proc. Fifth Int'l Conf. Multimodal Interfaces, pp. 73-76, 2003.
[17] S. Yairi, Y. Iwaya, and Y. Suzuki, “Estimation of Detection Threshold of System Latency of Virtual Auditory Display,” Applied Acoustics, vol. 68, pp. 851-863, 2007.
[18] D.S. Brungart, B.D. Simpson, A.J. Kordik, “The Detectability of Headtracker Latency in Virtual Audio Displays,” Proc. 11th Meeting of the Int'l Conf. Auditory Display, pp. 37-42, 2005.
[19] T. Maki-Patola and P. Hamalainen, “Latency Tolerance for Gesture Controlled Continuous Sound Instrument without Tactile Feedback,” Proc. Int'l Computer Music Conf., 2004.
[20] J.R. Dabrowski and E.V. Munson, “Is 100 milliseconds Too Fast?,” Proc. Conf. Human Factors in Computing Systems, pp. 317-318, 2001.
[21] K. Iwamoto and K. Komoriya, “Permissible Time Delay for Image Following in an Eye Movement Tracking Type Image Display System,” Proc. Eighth Conf. Intelligent Autonomous Systems, pp. 889-906, 2004.
[22] M. Komori, R. Yoshida, T. Matsuda, and T. Takahashi, “User Haptic Characteristics Measurement for Design of Medical VR Applications,” CARS 2000—Computer Assisted Radiology and Surgery, pp. 17-22, Elsevier, 2000.
[23] P. Dev, D. Harris, D. Gutierrez, A. Shah, and S. Senger, “End-to-End Performance Measurement of Internet Based Medical Applications,” Proc. 2002 Am. Medical Informatics Assoc. Ann. Symp., pp. 205-209, 2002.
[24] K. Hikichi, Y. Yasuda, A. Fukuda, and K. Sezaki, “The Effect of Network Delay on Remote Calligraphic Teaching with Haptic Interfaces,” Proc. Fifth ACM SIGCOMM Workshop Network and System Support for Games, Article no. 12, 2006.
[25] H. Nishino, S. Yamabiraki, Y. Kwon, Y. Okada, and K. Utsumiya, “A Distributed Virtual Reality Framework for Korea-Japan High-Speed Network Testbed,” Proc. 20th Int'l Conf. Advanced Information Networking and Applications, vol. 1, pp. 433-438, 2006.
[26] H. Ohnishi and K. Mochizuki, “Effect of Delay of Feedback Force on Perception of Elastic Force: A Psychophysical Approach,” IEICE Trans. Comm., vol. E90-B, no. 1, pp. 12-20, 2007.
[27] A. Pressman, L.J. Welty, A. Karniel, and F.A. Mussa Ivaldi, “Perception of Delayed Stiffness,” The Int'l J. Robotics Research, vol. 26, pp. 1191-1203, 2007.
[28] S.J. Lederman, “Tactile Roughness of Grooved Surfaces: The Touching Process and Effects of Macro-and Microsurface Structure,” Perception & Psychophysics, vol. 16, no. 2, pp. 385-395, 1974.
[29] S.J. Lederman, “Tactual Roughness Perception: Spatial and Temporal Determinants,” Canadian J. Psychology, vol. 37, no. 4, pp. 498-511, 1983.
[30] S.J. Lederman, R.L. Klatzky, C. Tong, and C. Hamilton, “The Perceived Roughness of Resistive Virtual Textures: II. Effects of Varying Viscosity with a Force-Feedback Device,” ACM Trans. Applied Perception, vol. 3, no. 1, pp. 15-30, 2006.
[31] R.L. Klatzky and S.J. Lederman, “The Perceived Roughness of Resistive Virtual Textures: I. Rendering by a Force-Feedback Mouse,” ACM Trans. Applied Perception, vol. 3, no. 1, pp. 1-14, 2006.
[32] J.W. Morley, A.W. Goodwin, and I. Darian-Smith, “Tactile Discrimination of Gratings,” Experimental Brain Research, vol. 49, pp. 291-299, 1983.
[33] G.D. Lamb, “Tactile Discrimination of Textured Surfaces: Psychophysical Performance Measurements in Humans,” J. Physiology, vol. 338, pp. 551-565, 1983.
[34] G.D. Goff, “Differential Discrimination of Frequency of Cutaneous Mechanical Vibration,” J. Experimental Psychology, vol. 74, no. 2, pp. 294-299, 1967.
[35] M. Rothenberg, R.T. Verrillo, S.A. Zahorian, M.L. Brachman, and S.J. BolanowskiJr., “Vibrotactile Frequency for Encoding a Speech Parameter,” J. Acoustical Soc. America, vol. 62, no. 4, pp. 1003-1012, 1977.
[36] C.J. Cascio and K. Sathian, “Temporal Cues Contribute to Tactile Perception of Roughness,” J. Neuroscience, vol. 21, no. 14, pp.5289-5296, 2001.
[37] E. Gamzu and E. Ahissar, “Importance of Temporal Cues for Tactile Spatial-Frequency Discrimination,” J. Neuroscience, vol. 21, no. 18, pp. 7416-7427, 2001.
[38] M. Hollins and S.R. Risner, “Evidence for the Duplex Theory of Tactile Texture Perception,” Perception & Psychophysics, vol. 62, no. 4, pp. 695-705, 2000.
[39] E.M. Meftah, L. Belingard, and C.E. Chapman, “Relative Effects of the Spatial and Temporal Characteristics of Scanned Surfaces on Human Perception of Tactile Roughness Using Passive Touch,” Experimental Brain Research, vol. 132, pp. 351-361, 2000.
[40] C.E. Connor and K.O. Johnson, “Neural Coding of Tactile Texture: Comparison of Spatial and Temporal Mechanisms for Roughness Perception,” J. Neuroscience, vol. 12, no. 9, pp. 3414-3426, 1992.

Index Terms:
Detection threshold, tactile display, time delay.
Shogo Okamoto, Masashi Konyo, Satoshi Saga, Satoshi Tadokoro, "Detectability and Perceptual Consequences of Delayed Feedback in a Vibrotactile Texture Display," IEEE Transactions on Haptics, vol. 2, no. 2, pp. 73-84, April-June 2009, doi:10.1109/TOH.2009.17
Usage of this product signifies your acceptance of the Terms of Use.