The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.01 - January/February (2008 vol.14)
pp: 146-159
ABSTRACT
We use our hands to manipulate objects in our daily life. The hand is capable of accomplishing diverse tasks such as pointing, gripping, twisting and tearing. However, there is not much work that considers using the hand as input in distributed virtual environments (DVEs), in particular over the Internet. The main reasons are that the Internet suffers from high network latency, which affects interaction, and the hand has many degrees of freedom, which adds additional challenges to synchronizing the collaboration. In this paper, we propose a prediction method specifically designed for human hand motion to address the network latency problem in DVEs. Through a thorough analysis of finger motion, we have identified various finger motion constraints and we propose a constraint-based motion prediction method for hand motion. To reduce the average prediction error under high network latency, e.g., over the Internet, we further propose a revised dead reckoning scheme here. Our performance results show that the proposed prediction method produces a lower prediction error than some popular methods while the revised dead reckoning scheme produces a lower average prediction error than the traditional dead reckoning scheme, in particular at high network latency.
INDEX TERMS
Motion Prediction, hand motion prediction, hand interaction, network latency
CITATION
Addison Chan, Rynson Lau, Lewis Li, "Hand Motion Prediction for Distributed Virtual Environments", IEEE Transactions on Visualization & Computer Graphics, vol.14, no. 1, pp. 146-159, January/February 2008, doi:10.1109/TVCG.2007.1056
REFERENCES
[1] L. Cutler, B. Frohlich, and P. Hanrahan, “Two-Handed Direct Manipulation on the Responsive Workbench,” Proc. ACM Symp. Interactive 3D Graphics, pp. 107-114, 1997.
[2] C. Shaw and M. Green, “THRED: A Two-Handed Design System,” Multimedia Systems J., vol. 5, pp. 126-139, 1997.
[3] J. Wong, R.W.H. Lau, and L. Ma, “Virtual 3D Sculpting,” J.Visualization and Computer Animation, vol. 11, no. 3, pp. 155-166, July 2000.
[4] F. Li, R.W.H. Lau, and F. Ng, “VSculpt: A Distributed Virtual Sculpting Environment for Collaborative Design,” IEEE Trans. Multimedia, vol. 5, no. 7, pp. 570-580, 2003.
[5] A. Chan, R.W.H. Lau, and B. Ng, “Motion Prediction for Caching and Prefetching in Mouse-Driven DVE Navigation,” ACM Trans. Internet Technology, vol. 5, no. 1, pp. 1-22, 2005.
[6] I. Vaghi, C. Greenhalgh, and S. Benford, “Coping with Inconsistency due to Network Delays in Collaborative Virtual Environments,” Proc. ACM Symp. Virtual Reality Software and Technology (VRST '99), pp. 42-49, 1999.
[7] T. Sheridan and W. Ferrell, “Remote Manipulative Control with Transmission Delay,” IEEE Trans. Human Factors in Electronics, vol. 4, no. 1, pp. 25-29, 1963.
[8] M. Mauve, J. Vogel, V. Hilt, and W. Effelsberg, “Local-Lag and Timewarp: Providing Consistency for Replicated Continuous Applications,” IEEE Trans. Multimedia, vol. 6, no. 1, pp. 47-57, 2004.
[9] IEEE Std. 1278, Distributed Interactive Simulation—Application Protocols, IEEE, 1998.
[10] S. Singhal and M. Zyda, Networked Virtual Environments: Design and Implementation. ACM Press, 1999.
[11] S. Singhal and D. Cheriton, “Exploiting Position History for Efficient Remote Rendering in Networked Virtual Reality,” Presence, vol. 4, no. 2, pp. 169-193, 1995.
[12] J. Chim, M. Green, R.W.H. Lau, A. Si, and H. Leong, “On Caching and Prefetching of Virtual Objects in Distributed Virtual Environments,” Proc. ACM Multimedia, pp. 171-180, Sept. 1998.
[13] R. Azuma and G. Bishop, “A Frequency-Domain Analysis of Head-Motion Prediction,” Proc. ACM SIGGRAPH '95, pp. 401-408, 1995.
[14] J. Liang, C. Shaw, and M. Green, “On Temporal-Spatial Realism in the Virtual Reality Environment,” Proc. ACM Symp. User Interface Software and Technology (UIST '91), pp. 19-25, 1991.
[15] T. Capin, I. Pandzic, N. Magnenat-Thalmann, and D. Thalmann, “A Dead-Reckoning Algorithm for Virtual Human Figures,” Proc. IEEE Virtual Reality Ann. Int'l Symp. (VRAIS '97), pp. 161-169, 1997.
[16] J. Wu and M. Ouhyoung, “On Latency Compensation and Its Effects on Head-Motion Trajectories in Virtual Environments,” The Visual Computer, vol. 16, no. 2, pp. 79-90, 2000.
[17] M. Isard and A. Blake, “CONDENSATION—Conditional Density Propagation for Visual Tracking,” Int'l J. Computer Vision, vol. 29, no. 1, pp. 5-28, 1998.
[18] J. LaViola Jr., “An Experimental Comparing Double Exponential Smoothing and Kalman Filter-Based Predictive Tracking Algorithms,” Proc. IEEE Virtual Reality Conf. (VR '03), pp. 283-284, 2003.
[19] VirtualHand Software Library Reference Manual. Virtual Tech nologies, 1998.
[20] E. Biryukova and V. Yourovskaya, “A Model of Human Hand Dynamics,” Advances in the Biomechanics of the Hand and Wrist, pp.107-122, Plenum Press, 1994.
[21] R. Cailliet, Hand Pain and Impairment, third ed. F.A. Davis, 1982.
[22] I. Kapandji, The Physiology of the Joints, vol. 1. Churchill Livingstone, 1982.
[23] J. Lee and T. Kunii, “Model-Based Analysis of Hand Posture,” IEEE Computer Graphics and Applications, vol. 15, pp. 77-86, 1995.
[24] H. Rijpkema and M. Girard, “Computer Animation of Knowledge-Based Human Grasping,” Proc. ACM SIGGRAPH '91, pp.339-348, 1991.
[25] T. Heap and D. Hogg, “Towards 3D Hand Tracking Using a Deformable Model,” Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition (FG '96), pp. 140-145, 1996.
[26] H. Zhou and T. Huang, “Tracking Articulated Hand Motion with Eigen Dynamics Analysis,” Proc. Eighth IEEE Int'l Conf. Computer Vision (ICCV '01), pp. 1102-1109, 2003.
[27] G. Welch and G. Bishop, An Introduction to the Kalman Filter, http://www.cs.unc.edu/~welch/kalmankalmanIntro.html , 2007.
[28] W. Wen and H. Durrant-Whyte, “Model Based Active Object Localization Using Multiple Sensors,” Proc. IEEE/RSJ Int'l Workshop Intelligent Robots and Systems (IROS '91), pp. 1448-1452, 1991.
[29] H. Durrant-Whyte, Integration, Coordination and Control of Multi-Sensor Robot Systems. Kluwer Academic, 1988.
[30] J. Geeter, H. Brussel, and J. Schutter, “A Smoothly Constrained Kalman Filter,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 11, pp. 1171-1177, Nov. 1997.
[31] D. Simon and T. Chia, “Kalman Filtering with State Equality Constraints,” IEEE Trans. Aerospace and Electronic Systems, vol. 39, no. 1, pp. 128-136, 2002.
[32] D. Simon and D. Simon, “Aircraft Turbofan Engine Health Estimation Using Constrained Kalman Filtering,” Proc. ASME Turbo Expo, 2003.
[33] J. Ohlenburg, “Improving Collision Detection in Distributed Virtual Environments by Adaptive Collision Prediction Tracking,” Proc. IEEE Virtual Reality Conf. (VR '04), pp. 83-90, 2004.
[34] W. Press, S. Teukolsky, W. Vetterling, and B. Flannery, Numerical Recipes in C++, second ed. Cambridge Univ. Press, 2002.
[35] A. Oppenheim and A. Willsky, Signal and Systems, second ed. Prentice Hall, 1997.
20 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool