This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Constraint Integration for Efficient Multiview Pose Estimation with Self-Occlusions
March 2008 (vol. 30 no. 3)
pp. 493-506
ASCII Text
x 
 
Abhinav Gupta, Anurag Mittal, Larry S. Davis, "Constraint Integration for Efficient Multiview Pose Estimation with Self-Occlusions," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 3, pp. 493-506, March, 2008.
 
 
BibTex
x
 
@article{ 10.1109/TPAMI.2007.1173,
author = {Abhinav Gupta and Anurag Mittal and Larry S. Davis},
title = {Constraint Integration for Efficient Multiview Pose Estimation with Self-Occlusions},
journal ={IEEE Transactions on Pattern Analysis and Machine Intelligence},
volume = {30},
number = {3},
issn = {0162-8828},
year = {2008},
pages = {493-506},
doi = {http://doi.ieeecomputersociety.org/10.1109/TPAMI.2007.1173},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - JOUR
JO - IEEE Transactions on Pattern Analysis and Machine Intelligence
TI - Constraint Integration for Efficient Multiview Pose Estimation with Self-Occlusions
IS - 3
SN - 0162-8828
SP493
EP506
EPD - 493-506
A1 - Abhinav Gupta,
A1 - Anurag Mittal,
A1 - Larry S. Davis,
PY - 2008
KW - 3D/stereo scene analysis
KW - Motion capture
KW - Tracking
VL - 30
JA - IEEE Transactions on Pattern Analysis and Machine Intelligence
ER -
 
Automatic initialization and tracking of human pose is an important task in visual surveillance. We present a part-based approach that incorporates a variety of constraints in a unified framework. These constraints include the kinematic constraints between parts that are physically connected to each other, the occlusion of one part by another and the high correlation between the appearance of certain parts, such as the arms. The location probability distribution of each part is determined by evaluating appropriate likelihood measures. The graphical (non-tree) structure representing the interdependencies between parts is utilized to “connect” such part distributions via nonparametric belief propagation. Methods are also developed to perform this optimization efficiently in the large space of pose configurations

[1] A. Agarwal and B. Triggs, “3D Human Pose from Silhouettes by Relevance Vector Regression,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 882-888, 2004.
[2] A. Balan, L. Sigal, and M. Black, “A Quantitative Evaluation of Video-Based 3D Person Tracking,” Proc. IEEE Int'l Workshop Visual Surveillance and Performance Evaluation of Tracking and Surveillance, 2005.
[3] M. Brand, “Shadow Puppetry,” Proc. Int'l Conf. Computer Vision, pp. 1237-1244, 1999.
[4] K.M. Cheung, S. Baker, and T. Kanade, “Shape-from-Silhouette of Articulated Objects and Its Use for Human Body Kinematics Estimation and Motion Capture,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 77-84, 2003.
[5] J.M. Coughlan and S.J. Ferreira, “Finding Deformable Shapes Using Loopy Belief Propagation,” Proc. European Conf. Computer Vision, pp. 453-468, 2002.
[6] N. Dalal and B. Triggs, “Histogram of Oriented Gradients for Human Detection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 886-893, 2005.
[7] Q. Delamarre and O. Faugeras, “3D Articulated Models and Multi-View Tracking with Silhouettes,” Proc. Int'l Conf. Computer Vision, pp. 716-721, 1999.
[8] J. Deutscher, A. Blake, and I. Reid, “Articulated Body Motion Capture by Annealed Particle Filtering,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 126-133, 2000.
[9] A. Elgammal and C. Lee, “Inferring 3D Body Pose from Silhouettes Using Activity Manifold Learning,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 681-688, 2004.
[10] P.F. Felzenszwalb and D.P. Huttenlocher, “Efficient Matching of Pictorial Structures,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 66-73, 2000.
[11] P.F. Felzenszwalb and D.P. Huttenlocher, “Pictorial Structures for Object Recognition,” Int'l J. Computer Vision, vol. 61, no. 1, pp. 55-79, 2005.
[12] D. Gavrila, “The Visual Analysis of Human Movement,” Computer Vision and Image Understanding, pp. 82-98, 1999.
[13] K. Grauman, G. Shankhnarovich, and T. Darrell, “Inferring 3D Structure with a Statistical Image-Based Shape Model,” Proc. Int'l Conf. Computer Vision, pp. 641-647, 2003.
[14] A. Gupta, A. Mittal, and L.S. Davis, “Constraint Integration for Multi-View Pose Estimation of Humans,” Proc. Int'l Symp. 3D Data Processing Visualization and Transmission, 2006.
[15] N.R. Howe, “Silhouette Lookup for Automatic Pose Tracking,” Proc. IEEE Workshop Articulated and Non-Rigid Motion, 2004.
[16] http://www.itl.nist.gov/iaui/ovrt/projects anthrokids/, 2007.
[17] G. Hua, M.-H. Yang, and Y. Wu, “Learning to Estimate Human Pose with Data Driven Belief Propagation,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 747-754, 2005.
[18] A. Ihler, J. Fisher, and A. Wilsky, “Loopy Belief Propagation: Convergence and Effects of Message Errors,” J. Machine Learning Research, vol. 6, pp. 905-936, 2005.
[19] S. Ioffe and D.A. Forsyth, “Finding People by Sampling,” Proc. Int'l Conf. Computer Vision, pp. 1092-1097, 1999.
[20] S. Ioffe and D.A. Forsyth, “Human Tracking with Mixtures of Trees,” Proc. Int'l Conf. Computer Vision, pp. 690-695, 2001.
[21] M. Isard, “Pampas: Real-Valued Graphical Models for Computer Vision,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 613-620, 2003.
[22] S. Ju, M. Black, and Y. Yacoob, “Cardboard People: A Parameterized Model of Articulated Motion,” Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 38-44, 1996.
[23] X. Lan and D.P. Huttenlocher, “Beyond Trees: Common-Factor Models for 2D Human Pose Recovery,” Proc. Int'l Conf. Computer Vision, vol. 1, pp. 470-477, 2005.
[24] M.W. Lee and I. Cohen, “Proposal Maps Driven MCMC for Estimating Human Body Pose in Static Images,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 334-341, 2004.
[25] J. MacCormick and M. Isard, “Partitioned Sampling, Articulated Objects and Interface-Quality Hand Tracking,” Proc. European Conf. Computer Vision, pp. 3-19, 2000.
[26] I. Mikic, M. Trivedi, E. Hunter, and P. Cosman, “Human Body Model Acquisition and Tracking Using Voxel Data,” Int'l J.Computer Vision, vol. 53, no. 3, pp. 199-223, 2003.
[27] K. Mikolajczyk, C. Schmid, and A. Zisserman, “Human Detection Based on a Probabilistic Assembly of Robust Part Detectors,” Proc. European Conf. Computer Vision, pp. 69-82, 2004.
[28] A. Mittal and L.S. Davis, “M2tracker: A Multi-View Approach to Segmenting and Tracking People in a Cluttered Scene,” Int'l J.Computer Vision, vol. 51, no. 3, pp. 189-203, 2003.
[29] A. Mittal, L. Zhao, and L. Davis, “Human Body Pose Estimation by Shape Analysis of Silhouettes,” Proc. Int'l Conf. Advanced Video and Signal Based Surveillance, 2003.
[30] T. Moeslund and E. Granum, “A Survey of Computer Vision-Based Human Motion Capture,” Computer Vision and Image Understanding, vol. 81, no. 3, pp. 231-268, 2001.
[31] A. Mohan, C. Papageorgiou, and T. Poggio, “Example Based Object Detection in Images by Components,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 4, pp. 349-361, Apr. 2001.
[32] G. Mori, X. Ren, A.A. Efros, and J. Malik, “Recovering Human Body Configurations: Combining Segmentation and Recognition,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp.326-333, 2004.
[33] J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, 1988.
[34] D. Ramanan and D.A. Forsyth, “Finding and Tracking People from the Bottom Up,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 467-474, 2003.
[35] D. Ramanan, D.A. Forsyth, and A. Zisserman, “Strike a Pose: Tracking People by Finding Stylized Poses,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 271-278, 2005.
[36] X. Ren, A. Berg, and J. Malik, “Recovering Human Body Configurations Using Pairwise Constraints between Parts,” Proc. Int'l Conf. Computer Vision, vol. 1, pp. 824-831, 2005.
[37] R. Ronfard, C. Schmid, and B. Triggs, “Learning to Parse Picture of People,” Proc. European Conf. Computer Vision, pp. 700-714, 2002.
[38] S. Roth, L. Sigal, and M.J. Black, “Gibbs Likelihoods for Bayesian Tracking,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 886-893, 2004.
[39] G. Shakhnarovich, P. Viola, and T. Darrell, “Fast Pose Estimation with Parameter Sensitive Hashing,” Proc. Int'l Conf. Computer Vision, pp. 750-757, 2003.
[40] M. Siddiqui, R. Rosales, J. Alon, and S. Sclaroff, “Estimating 3D Body Pose Using Uncalibrated Cameras,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 821-827, 2001.
[41] H. Sidenbladh, M.J. Black, and D.J. Fleet, “Stochastic Tracking of 3D Human Figures Using 2D Image Motion,” Proc. European Conf. Computer Vision, vol. 2, pp. 702-718, 2000.
[42] L. Sigal, S. Bhatia, S. Roth, M.J. Black, and M. Isard, “Tracking Loose-Limbed People,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 421-428, 2004.
[43] L. Sigal and M.J. Black, “Measure Locally, Reason Globally: Occlusion-Sensitive Articulated Pose Estimation,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2041-2048, 2006.
[44] L. Sigal, M. Isard, B.H. Sigelman, and M.J. Black, “Attractive People: Assembling Loose-Limbed Models Using Nonparametric Belief Propagation,” Proc. Ann. Conf. Neural Information Processing Systems, vol. 16, pp. 1539-1546, 2004.
[45] C. Sminchisescu, A. Kanaujia, Z. Li, and D. Metaxas, “Discriminative Density Propagation for 3D Human Motion Estimation,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 390-397, 2005.
[46] E. Sudderth, A. lhler, W. Freeman, and A. Willsky, “Nonparametric Belief Propagation,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 605-612, 2003.
[47] E. Sudderth, M. Mandel, W. Freeman, and A. Willsky, “Distributed Occlusion Reasoning for Tracking with Nonparametric Belief Propagation,” Proc. Ann. Conf. Neural Information Processing Systems, 2004.
[48] S. Tatikonda and M. Jordan, “Loopy Belief Propagation and Gibbs Measures,” Uncertainty in Artificial Intelligence, pp. 493-500, 2002.
[49] Z. Tu and S. Zhu, “Image Segmentation by Data Driven Markov Chain Monte Carlo,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 131-138, May 2002.
[50] P. Viola and M. Jones, “Rapid Object Detection Using Boosted Cascade of Simple Features,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 511-518, 2001.
[51] M. Wainwright, T. Jaakkola, and A. Wilsky, “Tree-Based Reparameterization Analysis of Sum-Product and Its Generalizations,” IEEE Trans. Information Theory, vol. 49, no. 5, pp. 1120-1146, 2003.
[52] Y. Weiss, “Interpreting Images by Propagating Bayesian Beliefs,” Proc. Ann. Conf. Neural Information Processing Systems, 1996.
[53] Y. Weiss, “Correctness of Local Probability Propagation in Graphical Model with Loops,” Neural Computation, vol. 12, no. 1, pp. 1-41, 2000.
[54] Y. Weiss and W. Freeman, “Correctness of Belief Propagation in Gaussian Graphical Models of Arbitrary Topology,” Neural Computation, vol. 13, pp. 2173-2200, 2001.

Index Terms:
3D/stereo scene analysis, Motion capture, Tracking
Citation:
Abhinav Gupta, Anurag Mittal, Larry S. Davis, "Constraint Integration for Efficient Multiview Pose Estimation with Self-Occlusions," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 3, pp. 493-506, March 2008, doi:10.1109/TPAMI.2007.1173
Usage of this product signifies your acceptance of the Terms of Use.