The Community for Technology Leaders
RSS Icon
Issue No.01 - January-March (2010 vol.3)
pp: 28-36
Zhuanghua Shi , Ludwig-Maximilians-Universität Müchen, Munich
Heng Zou , Ludwig-Maximilians-Universität Müchen, Munich
Markus Rank , Technische Universität Müchen, Munich
Lihan Chen , Ludwig-Maximilians-Universität Müchen, Munich
Sandra Hirche , Technische Universität Müchen, Munich
Hermann J. Müller , Ludwig-Maximilians-Universität Müchen, Munich
Temporal discontinuities and delay caused by packet loss or communication latency often occur in multimodal telepresence systems. It is known that such artifacts can influence the feeling of presence [1]. However, it is largely unknown how the packet loss and communication latency affect the temporal perception of multisensory events. In this article, we simulated random packet dropouts and communication latency in the visual modality and investigated the effects on the temporal discrimination of visual-haptic collisions. Our results demonstrated that the synchronous perception of crossmodal events was very sensitive to the packet loss rate. The packet loss caused the impression of time delay and influenced the perception of the subsequent events. The perceived time of the visual event increased linearly, and the temporal discrimination deteriorated, with increasing packet loss rate. The perceived time was also influenced by the communication delay, which caused time to be slightly overestimated.
Visual-haptic temporal perception, packet loss, psychophysics, perception.
Zhuanghua Shi, Heng Zou, Markus Rank, Lihan Chen, Sandra Hirche, Hermann J. Müller, "Effects of Packet Loss and Latency on the Temporal Discrimination of Visual-Haptic Events", IEEE Transactions on Haptics, vol.3, no. 1, pp. 28-36, January-March 2010, doi:10.1109/TOH.2009.45
[1] S.I. Mackenzie and C. Ware, "Lag As a Determinant of Human Performance in Interactive Systems," Proc. INTERACT '93 and CHI '93 Conf. Human Factors in Computing Systems, pp. 488-493, 1993.
[2] J. Steuer, "Defining Virtual Reality: Dimensions Determining Telepresence," J. Comm., vol. 42, no. 4, pp. 73-93, 1992.
[3] G. Hirzinger, B. Brunner, J. Dietrich, and J. Heindl, "Sensor-Based Space Robotics-Rotex and Its Telerobotic Features," IEEE Trans. Robotics and Automation, vol. 9, no. 5, pp. 649-663, Oct. 1993.
[4] S. Hirche and M. Buss, "Human Perceived Transparency with Time Delay," Advances in Telerobotics, M. Ferre, M. Buss, R. Aracil, C. Melchiorri, and C. Balaguer, eds., pp. 191-209, Springer STAR Series, 2007.
[5] R. Held, "Telepresence, Time Delay and Adaptation," Pictorial Comm. in Virtual and Real Environments, S.R. Ellis, M.K. Kaiser, and A.J. Grunwald, eds., pp. 232-246, Taylor and Francis, 1993.
[6] M. Claypool and J. Tanner, "The Effects of Jitter on the Peceptual Quality of Video," Proc. Seventh ACM Int'l Conf. Multimedia (Part 2), pp. 115-118, 1999.
[7] Z. Wang, Internet QoS: Architectures and Mechanisms for Quality of Service, first ed. Morgan Kaufmann, 2001.
[8] D. Hands and M. Wilkins, "A Study of the Impact of NetWork Loss, and Burst Size on Video Streaming Quality Acceptability," Proc. Sixth Int'l Workshop Interactive Distributed Multimedia Systems and Telecomm. Services, pp. 45-57, 1999.
[9] M. Yajnik, S. Moon, J. Kurose, and D. Towsley, "Measurement and Modelling of the Temporal Dependence in Packet Loss," Proc. Eighteenth Ann. Joint Conf. IEEE Computer and Comm. Societies, vol. 1, pp. 345-352, 1999.
[10] D. Wijesekera, J. Srivastava, A. Nerode, and M. Foresti, "Experimental Evaluation of Loss Perception in Continuous Media," Multimedia Systems, vol. 7, no. 6, pp. 486-499, 1999.
[11] T. Beigbeder, R. Coughlan, C. Lusher, J. Plunkett, E. Agu, and M. Claypool, "The Effects of Loss and Latency on User Performance in Unreal Tournament 2003," Proc. Third ACM SIGCOMM Workshop Network and System Support for Games, pp. 144-151, 2004.
[12] M. Dick, O. Wellnitz, and L. Wolf, "Analysis of Factors Affecting Players Performance and Perception in Multiplayer Games," Proc. Fourth ACM SIGCOMM Workshop Network and System Support for Games, pp. 1-7, 2005.
[13] E.N. Gilbert, "Capacity of A Burst-Noise Channel," Bell System Technical J., vol. 39, pp. 1253-1265, 1960.
[14] E.O. Elliot, "A Model of the Switched Telephone Network for Data Communications," Bell System Technical J., vol. 44, pp. 89-109, 1963.
[15] H. Sanneck, "Packet Loss Recovery and Control for Voice Transmission over the Internet," PhD dissertation, Technischen Univ. of Berlin, 2000.
[16] H. Kalmus, D.B. Fry, and P. Denes, "Effects of Delayed Visual Control on Writing, Drawing, and Tracing," Language and Speech, vol. 3, pp. 96-108, 1960.
[17] W.M. Smith, J.W. Mccrary, and K.U. Smith, "Delayed Visual Feedback and Behavior," Science, vol. 132, no. 3433, pp. 1013-1014, 1960.
[18] T.B. Sheridan and W.R. Ferrell, "Remote Manipulative Control with Transmission Delay," IEEE Trans. Human Factors in Electronics, vol. HFE-4, no. 1, pp. 25-29, Sept. 1963.
[19] W.R. Ferrell, "Delayed Force Feedback," Human Factors, vol. 8, pp. 449-455, 1966.
[20] M. Barth, T. Burkert, C. Eberst, N.O. Stoffler, and G. Farber, "Photo-Realistic Scene Prediction of Partially Unknown Environments for the Compensation of Time Delays in Telepresence Applications," Proc. IEEE Int'l Conf. Robotics and Automation, vol. 4, pp. 3132-3137, 2000.
[21] B.D. Adelstein, T.G. Lee, and S.R. Ellis, "Head Tracking Latency in Virtual Environments: Psychophysics and A Model," Human Factors and Ergonomics Soc. Ann. Meeting Proc., pp. 2083-2087, 2003.
[22] C. Jay, M. Glencross, and R. Hubbold, "Modeling the Effects of Delayed Haptic and Visual Feedback in a Collaborative Virtual Environment," ACM Trans. Computer-Human Interaction, vol. 14, no. 2,article 8, pp. 1-31, 2007.
[23] D.J. Levitin, K. Maclean, M. Mathews, and L. Chu, "The Perception of Cross-Modal Simultaneity," Int'l J. Computing and Anticipatory Systems, pp. 323-329, 2000.
[24] J.V. Stone, N.M. Hunkin, J. Porrill, R. Wood, V. Keeler, M. Beanland, M. Port, and N.R. Porter, "When is Now? Perception of Simultaneity," Proc. Royal Soc. B: Biological Sciences, vol. 268, no. 1462, pp. 31-8, 2001.
[25] C. Spence, F. Pavani, and J. Driver, "Spatial Constraints on Visual-Tactile Cross-Modal Distractor Congruency Effects," Cognitive, Affective, & Behavioral Neuroscience, vol. 4, no. 2, pp. 148-69, 2004.
[26] C. Spence, D.I. Shore, and R.M. Klein, "Multisensory Prior Entry." J. Experimental Psychology: General, vol. 130, no. 4, pp. 799-832, 2001.
[27] N.F. Dixon and L. Spitz, "The Detection of Auditory Visual Desynchrony," Perception, vol. 9, no. 6, pp. 719-721, 1980.
[28] K.P. Körding and D.M. Wolpert, "Bayesian Decision Theory in Sensorimotor Control." Trends in Cognitive Sciences, vol. 10, no. 7, pp. 319-326, 2006.
[29] Z. Shi, S. Hirche, W.X. Schneider, and J.H. Müller, "Influence of Visuomotor Action on Visual-Haptic Simultaneous Perception: A Psychophysical Study," Proc. 2008 Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 65-70, 2008.
[30] D. Collett, Modelling Binary Data, second ed. Chapman & Hall/CRC, 2002.
[31] A. Vatakis and C. Spence, "Evaluating the Influence of Frame Rate on the Temporal Aspects of Audiovisual Speech Perception," Neuroscience Letters, vol. 405, nos. 1/2, pp. 132-136, 2006.
[32] J.B.F. van Erp and P.J. Werkhoven, "Vibro-Tactile and Visual Asynchronies: Sensitivity and Consistency," Perception, vol. 33, no. 1, pp. 103-111, 2004.
32 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool