This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Motion Analysis of Articulated Objects from Monocular Images
April 2006 (vol. 28 no. 4)
pp. 625-636
This paper presents a new method of motion analysis of articulated objects from feature point correspondences over monocular perspective images without imposing any constraints on motion. An articulated object is modeled as a kinematic chain consisting of joints and links, and its 3D joint positions are estimated within a scale factor using the connection relationship of two links over two or three images. Then, twists and exponential maps are employed to represent the motion of each link, including the general motion of the base link and the rotation of other links around their joints. Finally, constraints from image point correspondences, which are similar to that of the essential matrix in rigid motion, are developed to estimate the motion. In the algorithm, the characteristic of articulated motion, i.e., motion correlation among links, is applied to decrease the complexity of the problem and improve the robustness. A point pattern matching algorithm for articulated objects is also discussed in this paper. Simulations and experiments on real images show the correctness and efficiency of the algorithms.

[1] J.K. Aggarwal, Q. Cai, W. Liao, and B. Sabata, “Articulated and Elastic Nonrigid Motion: A Review,” Proc. IEEE Workshop Motion of Nonrigid and Articulated Objects, pp. 2-14, 1994.
[2] J.K. Aggarwal and Q. Cai, “Human Motion Analysis: A Review,” Proc. IEEE Workshop Nonrigid and Articulated motion, pp. 90-102, 1997.
[3] T.B. Moeslund and E. Granum, “A Survey of Computer Vision-Based Human Motion Capture,” Computer Vision and Image Understanding, vol. 81, no. 3, pp. 231-268, 2001.
[4] J.A. Webb and J.K. Aggarwal, “Structure from Motion of Rigid and Jointed Motions,” Artificial Intelligence, vol. 19, pp. 107-130, 1982.
[5] R.J. Holt, A.N. Netravali, T.S. Huang, and R.J. Qian, “Determining Articulated Motion from Perspective Views: A Decomposition Approach,” Pattern Recognition, vol. 30, pp. 1435-1449, 1997.
[6] P. Chunhong, C. Shen, and M. Songde, “Motion Analysis of Articulated Objects and Its Application in Human Motion Analysis,” Chinese J. Electronics, vol. 9, no. 1, pp. 76-81, Jan. 2000.
[7] D. Sinclair and K. Zesar, “Further Constraints on Visual Articulated Motions,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 94-99, 1996.
[8] L.W. Campbell and A.F. Bobick, “Recognition of Human Body Motion Using Phase Space Constraints,” Proc. Fifth Int'l Conf. Computer Vision, pp. 624-630, 1995.
[9] I.A. Kakadiaris, D. Metaxas, and R. Bajcsy, “Active Part-Decomposition, Shape and Motion Estimation of Articulated Objects: A Physics-Based Approach,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 980-984, 1994.
[10] J. Deutscher, A. Blake, and I. Reid, “Articulated Body Motion Capture by Annealed Particle Filtering,” Proc. Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 126-133, 2000.
[11] D.M. Gavrila and L.S. Davis, “3-D Model Based Tracking of Human in Action: A Multiview Approach,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 73-80, 1996.
[12] H. Changbo, L. Yi, M. Songde, and L. Hanqing, “Human Posture Recognition Using Genetic Algorithms and Kalman Motion Estimation,” Chinese J. Electronics, vol. 9, no. 4, 2000.
[13] Y. Wu and T.S. Huang, “Capturing Articulated Human Hand Motion: A Divide-and-Conquer Approach,” Proc. Seventh Int'l Conf. Computer Vision, pp. 606-611, 1999.
[14] M.H. Lin, “Tracking Articulated Objects in Real-Time Range Image Sequences,” Proc. Int'l Conf. Computer Vision, pp. 648-653, Sept. 1999.
[15] N. Jojic, M. Turk, and T.S. Huang, “Tracking Self-Occluding Articulated Objects in Dense Disparity Maps,” Proc. Seventh Int'l Conf. Computer Vision, vol. 1, pp. 123-130, 1999.
[16] C. Sminchisescu and B. Triggs, “Estimating Articulated Human Motion with Covariance Scaled Sampling,” Int'l J. Robotics Research, vol. 22, no. 6, pp. 371-393, 2003.
[17] H. Sidenbladh, M. Black, and D. Fleet, “Stochastic Tracking of 3D Human Figures Using 2D Image Motion,” Proc. European Conf. Computer Vision, 2000.
[18] J.F. O'Brien, R.E. Bodenheimer Jr., G.J. Brostow, and J.K. Hodgins, “Automatic Joint Parameter Estimation from Magnetic Motion Capture Data,” Proc. Graphics Interface, pp. 53-60, 2000.
[19] N. Krahnstoever, M. Yeasin, and R. Sharma, “Automatic Acquisition and Initialization of Kinematic Models,” Proc. Conf. Conf. Computer Vision and Pattern Recognition, Technical Sketches, Dec. 2001.
[20] L. Herda and P. Fua, and R. Plänkers, R. Boulic, and D. Thalmann, “Skeleton-Based Motion Capture for Robust Reconstruction of Human Motion,” Proc. Conf. Computer Animation, pp. 77-83, May 2000.
[21] M. Iiyama, Y. Kameda, and M. Minoh, “Estimation of the Location of Joint Points of Human Body from Successive Volume Data,” Proc. 15th Int'l Conf. Pattern Recognition, vol. 3, pp. 695-698, Sept. 2000.
[22] M.C. Silaghi, R. Plänkers, R. Boulic, P. Fua, and D. Thalmann, “Local and Global Skeleton Fitting Techniques for Optical Motion Capture,” Proc. Workshop Modeling and Motion Capture Techniques for Virtual Environments (Captech '98), 1998.
[23] C. Barrón and I.A. Kakadiaris, “Estimating Anthropometry and Pose from a Single Uncalibrated Image,” Computer Vision and Image Understanding, vol. 81, no. 3, pp. 269-284, 2001.
[24] C. Bregler and J. Malik, “Tracking People with Twist and Exponential Maps,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 8-15, 1998.
[25] M.M. Covell, A. Rahimi, M. Harville, and T.J. Darrell, “Articulated-Pose Estimation Using Brightness- and Depth-Constancy Constraints,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 438-435, 2000.
[26] T. Drummond and R. Cipolla, “Real-Time Visual Tracking of Complex Structures,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 932-946, July 2002.
[27] A. Sundaresan, A. Chowdhury, and R. Chellappa, “Multiple View Tracking of Human Motion Modeled by Kinematic Chains,” Proc. Conf. Image Processing, 2004.
[28] S.M. Smith and J.M. Brady, “ASSET-2: Real-Time Motion Segmentation And Shape Tracking,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 8, pp. 814-820, 1995.
[29] G.D. Borshukov, G. Bozdagi, Y. Altunbasak, and A.M. Tekalp, “Motion Segmentation by Multistate Affine Classification,” IEEE Trans. Image Processing, vol. 6, no. 11, pp. 1591-1594, 1997.
[30] S.X. Ju, M.J. Black, and Y. Yacoob, “Cardboard People: A Parameterized Model of Articulated Image Motion,” Proc. Second Conf. Automatic Face and Gesture Recognition, pp. 38-44, 1996.
[31] H.C. Longuet-Higgins, “A Computer Program for Reconstructing a Scene from Two Projections,” Nature, vol. 293, pp. 133-135, Sept. 1981.
[32] T.S. Huang and A.N. Netravali, “Motion and Structure from Feature Correspondence: A Review,” Proc. IEEE, vol. 82, no. 2, pp. 252-268, Feb. 1994.
[33] R.M. Murray, Z. Li, and S.S. Sastry, A Mathematical Introduction to Robotic Manipulation. CRC Press, 1994.
[34] X. Zhang and Y. Liu, “Point Pattern Matching for Articulated or Multiple Objects,” Proc. 17th Int'l Conf. Pattern Recognition, vol. 3, 2004.
[35] J. Feldmar and N. Ayache, “Rigid, Affine and Locally Affine Registration of Free-Form Surfaces,” Int'l J. Computer Vision, vol. 18, no. 2, pp. 99-119, 1996.
[36] J.C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms. New York: Plenum Press, 1981.

Index Terms:
Articulated object, kinematic chain, motion estimation, exponential map, point pattern matching.
Citation:
Xiaoyun Zhang, Yuncai Liu, Thomas S. Huang, "Motion Analysis of Articulated Objects from Monocular Images," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 4, pp. 625-636, April 2006, doi:10.1109/TPAMI.2006.78
Usage of this product signifies your acceptance of the Terms of Use.