Issue No.01 - First Quarter (2013 vol.6)
pp: 106-116
Sara Mulatto , University of Siena, Siena
Alessandro Formaglio , University of Siena, Siena
Monica Malvezzi , University of Siena, Siena
Domenico Prattichizzo , University of Siena, Siena
A technique to animate a realistic hand avatar with 20 DoFs based on the biomechanics of the human hand is presented. The animation does not use any sensor glove or advanced tracker with markers. The proposed approach is based on the knowledge of a set of kinematic constraints on the model of the hand, referred to as postural synergies, which allows to represent the hand posture using a number of variables lower than the number of joints of the hand model. This low-dimensional set of parameters is estimated from direct measurement of the motion of thumb and index finger tracked using two haptic devices. A kinematic inversion algorithm has been developed, which takes synergies into account and estimates the kinematic configuration of the whole hand, i.e., also of the fingers whose end tips are not directly tracked by the two haptic devices. The hand skin is deformable and its deformation is computed using a linear vertex blending technique. The proposed synergy-based animation of the hand avatar involves only algebraic computations and is suitable for real-time implementation as required in haptics.
Joints, Avatars, Kinematics, Thumb, Haptic interfaces, Indexes, Humans, hand avatar, Haptics, postural synergies
Sara Mulatto, Alessandro Formaglio, Monica Malvezzi, Domenico Prattichizzo, "Using Postural Synergies to Animate a Low-Dimensional Hand Avatar in Haptic Simulation", IEEE Transactions on Haptics, vol.6, no. 1, pp. 106-116, First Quarter 2013, doi:10.1109/TOH.2012.13
[1] N. Magnenat-Thalmann, R. Laperriere, and D. Thalmann, "Joint-Dependent Local Deformations for Hand Animation and Object Grasping," Proc. Graphics Interface, vol. 88, pp. 26-33, 1988.
[2] H. Rijpkema and M. Girard, "Computer Animation of Knowledge-Based Human Grasping," Proc. ACM SIGGRAPH, vol. 25, no. 4, pp. 339-348, 1991.
[3] H. Delingette, Y. Watanabe, and Y. Suenaga, "Simplex Based Animation," Models and Techniques in Computer Animation, pp. 13-28, Springer-Verlag, 1993.
[4] T. Kunii, Y. Tsuchida, Y. Arai, H. Matsuda, M. Shirahama, and S. Miura, "A Model of Hands and Arms Based on Manifold Mappings," Comm. with Virtual Worlds, vol. 93, pp. 381-398, 1993.
[5] A. Witkin and Z. Popovic, "Motion Warping," Proc. 22nd Ann. Computer Graphics and Interactive Techniques, pp. 105-108, 1995.
[6] T. Ullmann and J. Sauer, "Intuitive Virtual Grasping for non Haptic Environments," Proc. Eighth Pacific Conf. Computer Graphics and Applications, pp. 373-457, 2000.
[7] M. Bouzit, G. Burdea, G. Popescu, and R. Boian, "The Rutgers Master II-New Design Force-Feedback Glove," IEEE/ASME Trans. Mechatronics, vol. 7, no. 2, pp. 256-263, June 2002.
[8] H. Wan, Y. Luo, S. Gao, and Q. Peng, "Realistic Virtual Hand Modeling with Applications for Virtual Grasping," Proc. ACM SIGGRAPH, pp. 81-87, 2004.
[9] C. Garre, F. Hernández, A. Gracia, and M. Otaduy, "Interactive Simulation of a Deformable Hand for Haptic Rendering," Proc. IEEE Fourth World Haptics Conf., pp. 239-244, 2011.
[10] V. Frati and D. Prattichizzo, "Using kinect for Hand Tracking and Rendering in Wearable Haptics," Proc. World Haptics Conf. (WHC), pp. 317-321, Jun. 2011.
[11] L. Jones and S. Lederman, Human Hand Function. Oxford Univ. Press, 2006.
[12] M. Santello, M. Flanders, and J. Soechting, "Postural Hand Synergies for Tool Use," J. Neuroscience, vol. 18, no. 23, pp. 10105-10115, Dec. 1998.
[13] S. Cobos, M. Ferre, M. Sánchez-Urán, J. Ortego, and R. Aracil, "Human Hand Descriptions and Gesture Recognition for Object Manipulation," Computer Methods in Biomechanics and Biomedical Eng., vol. 13, no. 3, pp. 305-317, 2010.
[14] M. Ciocarlie, C. Goldfeder, and P. Allen, "Dimensionality Reduction for Hand-Independent Dexterous Robotic Grasping," Proc. IEEE/RSJ Int'l Conf. Intelligent Robots and Systems, pp. 3270-3275, 2007.
[15] D. Prattichizzo, M. Malvezzi, and A. Bicchi, "On Motion and Force Controllability of Grasping Hands with Postural Synergies," Proc. Robotics: Science and Systems Conf., pp. 49-56, June 2010.
[16] M. Gabiccini, A. Bicchi, D. Prattichizzo, and M. Malvezzi, "On the Role of Hand Synergies in the Optimal Choice of Grasping Forces," Autonomous Robots, vol. 31, pp. 235-252, 2011.
[17] D. Prattichizzo, M. Malvezzi, M. Gabiccini, and A. Bicchi, "On the Manipulability Ellipsoids of Underactuated Robotic Hands with Compliance," Robotics and Autonomous Systems, vol. 60, no. 3, pp. 337-346, Mar. 2012.
[18] L. Kavan, "Real-Time Skeletal Animation," PhD dissertation, Faculty of Electrical Eng. Dept. of Computer Science and Eng., Czech Technical Univ., 2007.
[19] S. Mulatto, A. Formaglio, M. Malvezzi, and D. Prattichizzo, "Animating a Synergy-Based Deformable Hand Avatar for Haptic Grasping," Eurohaptics '10: Proc. Int'l Conf. Haptics - Generating and Perceiving Tangible Sensations, pp. 203-210, 2010.
[20] J. Lee and T. Kunii, "Model-Based Analysis of Hand Posture," IEEE Computer Graphics and Applications, vol. 15, no. 5, pp. 77-86, Sept. 1995.
[21] J. Lin, Y. Wu, and T. Huang, "Modeling the Constraints of Human Hand Motion," Proc. Workshop Human Motion, pp. 121-126, 2000.
[22] R. Linscheid, K. An, and R. Gross, "Quantitative Analysis of the Intrinsic Muscles of the Hand," Clinical Anatomy, vol. 4, no. 4, pp. 265-284, 1991.
[23] K. Kim, Y. Youm, and W. Chung, "Human Kinematic Factor for Haptic Manipulation: The Wrist to Thumb," HAPTICS '02: Proc. 10th Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 319-326, 2002.
[24] Y. Youm, M. Holden, and K. Dohrmann, "Finger Ray Ratio Study," Technical Report on Wrist Project No. 10, The Univ. Iowa, 1977.
[25] G. Baud-Bovy, D. Prattichizzo, and N. Brogi, "Does Torque Minimization Yield a Stable Human Grasp?" Multi-Point Physical Interaction with Real and Virtual Objects, series STAR, Springer Tracks in Advanced Robotics, F. Barbagli, D. Prattichizzo, and K. Salisbury, eds., pp. 21-40, Springer, 2005.
[26] E. Chao, Biomechanics of the Hand: A Basic Research Study. World Scientific Publishing Company, 1989.
[27] M. Santello, M. Flanders, and J. Soechting, "Gradual Molding of the Hand to Object Contours," J. Neuroscience, vol. 79, no. 3, pp. 1307-1320, Mar. 1998.
[28] M. Santello and J. Soechting, "Force Synergies for Multifingered Grasping," Experimental Brain Research, vol. 133, no. 4, pp. 457-467, Aug. 2000.
[29] Y. Umetani and K. Yoshida, "Resolved Motion Rate Control of Space Manipulators with Generalized Jacobian Matrix," IEEE Trans. Robotics and Automation, vol. 5, no. 3, pp. 303-314, June 1989.
[30] L. Sentis and O. Khatib, "Control of Free-Floating Humanoid Robots through Task Prioritization," Proc. IEEE Int'l Conf. Robotics and Automation (ICRA), pp. 1718-1723, 2005.
[31] D. Prattichizzo and J. Trinkle, "Grasping," Handbook on Robotics, B. Siciliano and O. Kathib, eds., pp. 671-700. Springer, 2008.
[32] A. Balestrino, G. De Maria, and L. Sciavicco, "Robust Control of Robotic Manipulators," Proc. Ninth IFAC World Congress, vol. 5, pp. 2435-2440, 1984.
[33] W. Wolovich and H. Elliott, "A Computational Technique for Inverse Kinematics," Proc. IEEE 23rd Conf. Decision and Control, vol. 23, pp. 1359-1363, 1984.
[34] L. Sciavicco and B. Siciliano, "A Solution Algorithm to the Inverse Kinematic Problem for Redundant Manipulators," IEEE J. Robotics and Automation, vol. 4, no. 4, pp. 403-410, Aug. 1988.
[35] K.B. Shimoga, "A Survey of Perceptual Feedback Issues in Dexterous Telemanipulation. II. Finger Touch Feedback," Proc. IEEE Virtual Reality Ann. Int'l Symp., pp. 271-279, Sept. 1993.
[36] M. DirectX, http:/, 2012.
[37] M. de Pascale and D. Prattichizzo, "The Haptik Library: A Component Based Architecture for Uniform Access to Haptic Devices," IEEE Robotics and Automation Magazine, vol. 14, no. 4, pp. 64-75,, Dec. 2007.
[38] A. Formaglio, M. Fei, S. Mulatto, M. de Pascale, and D. Prattichizzo, "Autocalibrated Gravity Compensation for 3DoFs Impedance Haptic Devices," Proc. Eurohaptics '08, pp. 43-52, 2008.
[39] N. PhysX, , 2012.
[40] C. Zilles and J. Salisbury, "A Constraint-Based God-Object Method for Haptic Display," Proc. IEEE Int'l Conf. Intelligent Robots and Systems, vol. 3, pp. 146-151, 1995.
[41] W. Harwin and N. Melder, "Improved Haptic Rendering for Multi-Finger Manipulation Using Friction Cone Based God-Objects," Proc. Eurohaptics Conf., pp. 82-85, 2002.
[42] F. Barbagli, A. Frisoli, K. Salisbury, and M. Bergamasco, "Simulating Human Fingers: a Soft Finger Proxy Model and Algorithm," HAPTICS '04: Proc. 12th Int'l Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 9-17. 2004.
[43] T. Moller and B. Trumbore, "Fast, Minimum Storage Ray-Triangle Intersection," J. Graph Tools, vol. 2, no. 1, pp. 21-28, 1997.
[44] G. Van Den Bergen and G. van den Bergen, Collision Detection in Interactive 3D Environments. Morgan Kaufmann, 2004.
[45] J. Colgate and J. Brown, "Factors Affecting the z-Width of a Haptic Display," Proc. IEEE Int'l Conf. Robotics and Automation, pp. 3205-3205, 1994.
[46] J. Colgate and G. Schenkel, "Passivity of a Class of Sampled-Data Systems: Application to Haptic Interfaces," J. Robotic Systems, vol. 14, no. 1, pp. 37-47, 1997.