This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Object Tracking Using Deformable Templates
May 2000 (vol. 22 no. 5)
pp. 544-549

Abstract—We propose a novel method for object tracking using prototype-based deformable template models. To track an object in an image sequence, we use a criterion which combines two terms: the frame-to-frame deviations of the object shape and the fidelity of the modeled shape to the input image. The deformable template model utilizes the prior shape information which is extracted from the previous frames along with a systematic shape deformation scheme to model the object shape in a new frame. The following image information is used in the tracking process: 1) edge and gradient information: the object boundary consists of pixels with large image gradient, 2) region consistency: the same object region possesses consistent color and texture throughout the sequence, and 3) interframe motion: the boundary of a moving object is characterized by large interframe motion. The tracking proceeds by optimizing an objective function which combines both the shape deformation and the fidelity of the modeled shape to the current image (in terms of gradient, texture, and interframe motion). The inherent structure in the deformable template, together with region, motion, and image gradient cues, makes the proposed algorithm relatively insensitive to the adverse effects of weak image features and moderate amounts of occlusion.

[1] N. Ayache, I. Cohen, and I. Herlin, "Medical Image Tracking," Active Vision, chapter 17. MIT Press, Dec. 1992.
[2] B. Bascle, P. Bouthemy, R. Deriche, and F. Meyer, “Tracking Complex Primitives in an Image Sequence,” Proc. 12th Int'l Conf. Pattern Recognition, vol. I, pp. 426-431, Oct. 1994.
[3] B. Bascle and R. Deriche, “Region Tracking Through Image Sequences,“ Proc. Fifth IEEE Int'l Conf. Computer Vision (ICCV), pp. 302-307, June 1995.
[4] A. Blake, R. Curwen, and A.A. Zisserman, “A Framework for Spatiotemporal Control in the Tracking of Visual Contours,” Int'l J. Computer Vision, vol. 11, no. 2, pp. 127-145, Oct. 1993.
[5] T.F. Cootes, C.J. Taylor, D.H. Cooper, and J. Graham, "Active Shape Models—Their Training and Application," Computer Vision and Image Understanding, vol. 61, no. 1, pp. 38-59, Jan. 1995.
[6] D. DeCarlo and D. Metaxas, “The Integration of Optical Flow and Deformable Models: Applications to Human Face Shape and Motion Estimation,” Proc. IEEE Computer Vision and Pattern Recognition (CVPR '96), pp. 231-238, 1996.
[7] P. Fieguth and D. Terzopoulos, Color-Based Tracking of Heads and Other Objects at Video Frame Rates Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 1997.
[8] P. Fua and Y.G. Leclerc, “Object-Centered Surface Reconstruction: Combining Multi-Image Stereo and Shading,” Int'l J. Computer Vision, vol. 16, pp. 35-56, Sept. 1995.
[9] B. Heisele, U. Kressel, and W. Ritter, Tracking Non-Rigid, Moving Objects Based on Color Cluster Flow Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1997.
[10] M. Isard and A. Blake, “Contour Tracking by Stochastic Propagation of Conditional Density,” Proc. European Conf. Computer Vision, pp. 343-356, 1996.
[11] A.K. Jain, Y. Zhong, and S. Lakshmanan, Object Matching Using Deformable Templates IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 3, pp. 267-278, Mar. 1996.
[12] I.A. Kakadiaris and D. Metaxas, “Model-Based Estimation of 3D Human Motion with Occlusion Based on Active Multi-Viewpoint Selection,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 81–87, June 1996.
[13] M. Kass, A. Witkin, and D. Terzopoulos, “Snakes: Active Contour Models,“ Int'l J. Computer Vision, vol. 1, no. 4, pp. 321-331, 1988.
[14] C. Kervrann and F. Heitz, “Robust Tracking of Stochastic Deformable Models in Long Image Sequences,” Proc. Int'l Conf. Image Processing (ICIP), vol. 3, pp. 88-92, 1994.
[15] A. Lanitis, C.J. Taylor, and T.F. Cootes, "A Unified Approach to Coding and Interpreting Face Images," Int'l Conf. Computer Vision, 1995, pp. 368-373.
[16] F. Leymarie and M. Levine, "Tracking deformable objects in the plane using an active contour model, IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 6, pp. 617-634, June 1993.
[17] R. Malladi, J. Sethian, and B.C. Vemuri, "Shape Modeling with Front Propagation: A Level Set Approach," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, pp. 158-175, 1995.
[18] N. Paragios and R. Deriche, Geodesic Active Contours and Level Sets for the Detection and Tracking of Moving Objects IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, pp. 1-15, 2000.
[19] D. Terzopoulos and R. Szeliski, “Tracking with Kalman Snakes,” Active Vision, A. Blake and A. Yuille, eds., pp. 3-20, MIT Press, 1992.
[20] D. Terzopolous, A. Witkin, and M. Kass, "Constraints on deformable models: Recovering 3D shape and nonrigid motion, AI, no. 36, pp. 91-123, 1988.
[21] D. Terzopoulos and K. Waters, "Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 6, pp. 569-579, 1993.
[22] A.L. Yuille and P.W. Hallinan, “Deformable Templates,” A. Blake and A. Yuille, eds., Active Vision, MIT Press, 1992.
[23] Y. Zhong, A.K. Jain, and M.P. Dubuisson-Jolly, “Object Tracking Using Deformable Templates,” Proc. Sixth IEEE Int'l Conf. Computer Vision (ICCV), pp. 440-445, 1998.
[24] S.C. Zhu, T.S. Lee, and A.L. Yuille, “Region Competition: Unifying Snakes, Region Growing, Energy/Bayes/MDL for Multiband Image Segmentation,” Proc. Fifth IEEE Int'l Conf. Computer Vision (ICCV), pp. 416-423, 1995.

Index Terms:
Tracking, image sequence deformable template, shape, texture, motion.
Citation:
Yu Zhong, Anil K. Jain, M.-p. Dubuisson-Jolly, "Object Tracking Using Deformable Templates," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 5, pp. 544-549, May 2000, doi:10.1109/34.857008
Usage of this product signifies your acceptance of the Terms of Use.