This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Model-Based Estimation of 3D Human Motion
December 2000 (vol. 22 no. 12)
pp. 1453-1459

Abstract—This paper presents the formulations and techniques that we have developed for the three-dimensional, model-based, motion estimation of human movement from multiple cameras. Our method is based on the spatio-temporal analysis of the subject's silhouette and it has the advantage that the subject does not have to wear markers or other devices. We present tracking results from experiments involving the recovery of complex motions in the presence of significant occlusion.

[1] J.K. Aggarwal and Q. Cai, “Human Motion Analysis: A Review,” Proc. IEEE Nonrigid and Articulated Motion Workshop, pp. 90–102, June 1997.
[2] A. Azarbayejani, C. Wren, and A. Pentland, “Real-Time 3-D Tracking of the Human Body,” Proc. IMAGE'COM 96, May 1996.
[3] C. Barrón and I.A. Kakadiaris, “Estimating Anthropometry and Pose from a Single Image,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 669–676, June 2000.
[4] C. Bregler and J. Malik, “Tracking People with Twists and Exponential Maps,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 8–15, June 1998.
[5] T.J. Cham and J. Rehg, “A Multiple Hypothesis Approach to Figure Tracking,” Proc. Conf. Computer Vision and Pattern Recognition, vol. II, pp. 239–245, June 1999.
[6] Q. Delamarre and O. Faugeras, “3D Articulated Models and Multi-View Tracking with Silhouettes,” Proc. 17th Int'l Conf. Computer Vision, pp. 716–721, Sept. 1999.
[7] J. Deutscher, A. Blake, and I. Reid, “Articulated Body Motion Capture by Annealed Particle Filtering,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 126–133, June 2000.
[8] I. Douros, L. Dekker, and B.F. Buxton, “An Improved Algorithm for Reconstruction of the Surface of the Human Body from the 3D Scanner Data using Local B-Spline Parches,” Proc. IEEE Int'l Workshop Modeling People, pp. 29–36, Sept. 1999.
[9] J. Feldmar, N. Ayache, and F. Betting, “3D-2D Projective Registration of Free-Form Curves and Surfaces,” Proc. Fifth Int'l Conf. Computer Vision, pp. 549–556, June 1995.
[10] W. Frey, M. Zyda, R. McGhee, and W. Cockayne, “Off-The-Shelf, Real-Time, Human Body Motion Capture for Synthetic Environments,” Technical Report NPSCS-96-003, Computer Science Dept., Naval Postgraduate School, Monterey, Calif., June 1996.
[11] D.M. Gavrila, “The Visual Analysis of Human Movement: A Survey,” Computer Vision and Image Understanding, vol. 73, no. 1, Jan. 1999.
[12] D.M. Gavrila and L.S. Davis, “3-D Model-Based Tracking of Humans in Action: A Multi-View Approach,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 73–80, June 1996.
[13] L. Goncalves, E. DiBernardom, E. Ursella, and P. Perona, “Monocular Tracking of The Human Arm in 3D,” Proc. Fifth Int'l Conf. Computer Vision, pp. 764–770, June 1995.
[14] J. Gu, T. Chang, I. Mak, S. Gopalsamy, H.C. Shen, and M.F. Yuen, “A 3D Reconstruction System for Human Body Modeling,” Proc. CAPTECH '98, N. Magnenat-Thalmann and D. Thalmann, eds., pp. 229–241, Nov. 1998.
[15] A. Hilton, “Towards Model-Based Capture of a Person's Shape, Appearance and Motion,” Proc. IEEE Int'l Workshop Modeling People, pp. 37–44, Sept. 1999.
[16] S. Iwasawa, J. Ohya, K. Takahashi, T. Sakaguchi, S. Kawato, K. Ebihara, and S. Morishima, “Real-Time, 3D Estimation of Human Body Postures from Trinocular Images,” Proc. IEEE Int'l Workshop Modeling People, pp. 3–10, Sept. 1999.
[17] I.A. Kakadiaris, “Motion-Based Part Segmentation, Shape and Motion Estimation of Multi-Part Objects: Application to Human Body Tracking,” PhD dissertation, Dept. of Computer Science, Univ. of Pennsylvania, Philadelphia, Penn., Oct. 1996.
[18] I.A. Kakadiaris and D. Metaxas, “Model-Based Estimation of 3D Human Motion with Occlusion Based on Active Multi-Viewpoint Selection,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 81–87, June 1996.
[19] I.A. Kakadiaris and D. Metaxas, “3D Human Body Model Acquisition from Multiple Views,” Int'l J. Computer Vision, vol. 30, no. 3, pp. 191–218, 1998.
[20] I.A. Kakadiaris and D. Metaxas, “Vision-Based Animation of Digital Humans,” Proc. Computer Animation '98 Conf., pp. 144–152, June 1998.
[21] V. Kumar, R. Bajcsy, W. Harwin, and P. Harker, “Rapid Design and Prototyping of Customized Rehabilitation Aids,” Comm. ACM, vol. 39, no. 2, pp. 55–61, Feb. 1996.
[22] H.J. Lee and Z. Chen, “Determination of 3D Human Body Postures from a Single View,” Computer Vision, Graphics, and Image Processing, vol. 30, pp. 148–168, May 1985.
[23] D. Metaxas and D. Terzopoulos, “Shape and Non-Rigid Motion Estimation through Physics-Based Synthesis,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 6, pp. 580-591, June 1993.
[24] D.D. Morris, J.M. Rehg, “Singularity Analysis for Articulated Object Tracking,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 289–296, June 1998.
[25] D. Ormoneit, H. Sidenbladh, M.J. Black, T. Hastie, and D.J. Fleet, “Learning and Tracking Human Motion using Functional Analysis,” Proc. IEEE Workshop Human Modeling, Analysis and Synthesis, pp. 2–9, June 2000.
[26] J. O'Rourke and N.I. Badler, “Model-Based Image Analysis of Human Motion using Constraint Propagation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 2, no. 6, pp. 522–536, June 1980.
[27] A. Pentland, “Machine Understanding of Human Action,” Proc. Seventh Int'l Forum on Frontier of Telecommunication Technology, Nov. 1995.
[28] R. Plankers, P. Fua, and N. D'Apuzzo, “Automated Body Modeling from Video Sequences,” Proc. IEEE Int'l Workshop Modeling People, pp. 45–52, Sept. 1999.
[29] J.M. Rehg and T. Kanade, “Model-Based Tracking of Self-Occluding Articulated Objects,” Proc. Fifth Int'l Conf. Computer Vision, pp. 612–617, June 1995.
[30] R. Sharma, T.S. Huang, V.I. Pavlovic, “A Multimodal Framework for Interacting with Virtual Environments,” Human Interaction with Complex Systems, C.A. Ntuen, E.H. Park, and J.H. Kim, eds., 1996.
[31] S. Wachter and H.-H. Nagel, “Tracking of Persons in Monocular Image Sequences,” Proc. IEEE Nonrigid and Articulated Motion Workshop, pp. 2–9, June 1997.
[32] C. Wren, A. Azarbayejani, T. Darrell, and A. Pentland, “Pfinder: Real-Time Tracking of the Human Body,” Proc. Second Int'l Conf. Automatic Face and Gesture Recognition, pp. 51–56, Apr. 1998.
[33] M. Yamamoto, A. Sato, and S. Kawada, “Icremental Tracking of Human Actions from Multiple Views,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 2–7, June 1998.
[34] M. Yamamoto and K. Yagishita, “Scene Constraints-Aided Tracking of Human Body,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 151–156, June 2000.

Index Terms:
Motion estimation, human motion estimation, deformable models, model-based tracking, physics-based modeling.
Citation:
Ioannis Kakadiaris, Dimitris Metaxas, "Model-Based Estimation of 3D Human Motion," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 12, pp. 1453-1459, Dec. 2000, doi:10.1109/34.895978
Usage of this product signifies your acceptance of the Terms of Use.