This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Geodesic Active Contours and Level Sets for the Detection and Tracking of Moving Objects
March 2000 (vol. 22 no. 3)
pp. 266-280

Abstract—This paper presents a new variational framework for detecting and tracking multiple moving objects in image sequences. Motion detection is performed using a statistical framework for which the observed interframe difference density function is approximated using a mixture model. This model is composed of two components, namely, the static (background) and the mobile (moving objects) one. Both components are zero-mean and obey Laplacian or Gaussian law. This statistical framework is used to provide the motion detection boundaries. Additionally, the original frame is used to provide the moving object boundaries. Then, the detection and the tracking problem are addressed in a common framework that employs a geodesic active contour objective function. This function is minimized using a gradient descent method, where a flow deforms the initial curve towards the minimum of the objective function, under the influence of internal and external image dependent forces. Using the level set formulation scheme, complex curves can be detected and tracked while topological changes for the evolving curves are naturally managed. To reduce the computational cost required by a direct implementation of the level set formulation scheme, a new approach named Hermes is proposed. Hermes exploits aspects from the well-known front propagation algorithms (Narrow Band, Fast Marching) and compares favorably to them. Very promising experimental results are provided using real video sequences.

[1] N. Diehl, “Object-Oriented Motion Estimation and Segmentation in Image Sequences,” IEEE Trans. Image Processing, vol. 3, pp. 1,901-1,904, Feb. 1990.
[2] H.H. Nagel, G. Socher, H. Kollnig, and M. Otte, “Motion Boundary Detection in Image Sequences by Local Stochastic Tests,” Proc. European Conf. Computer Vision, vol. II, pp. 305-315, 1994.
[3] S. Liou and R. Jain, “Motion Detection in Spatio-Temporal Space,” Computer Vision, Graphics, and Image Understanding, 1989.
[4] T. Aach and A. Kaup, “Bayesian Algorithms for Adaptive Change Detection in Image Sequences Using Markov Random Fields,” Signal Processing: Image Comm, vol. 7, pp. 147-160, 1995.
[5] J.M. Odobez and P. Bouthemy, “Robust Multiresolution Estimation of Parametric Motion Models,” J. Visual Comm. and Image Representation, vol. 6, pp. 348-365, 1995.
[6] N. Paragios and G. Tziritas, “Adaptive Detection and Localization of Moving Objects in Image Sequences,” Signal Processing: Image Comm., vol. 14, pp. 277-296, 1999.
[7] T.J. Broida and R. Chellappa, "Estimation of Object Motion Parameters From Noisy Images," IEEE Trans. Pattern Analysis and Machine Intelligence, 1986, pp. 90-99.
[8] F. Meyer and P. Bouthemy, “Region-Based Tracking Using Affine Motion Models in Long Image Sequences,” CVGIP: Image Understanding, vol. 60, no. 2, Sept. 1994.
[9] B. Bascle and R. Deriche, “Region Tracking Through Image Sequences,“ Proc. Fifth IEEE Int'l Conf. Computer Vision (ICCV), pp. 302-307, June 1995.
[10] D.G. Lowe, “Robust Model-Based Motion Tracking through the Integration of Search and Estimation,” Int'l J. Computer Vision, vol. 8, no. 2, pp. 113-122, 1992.
[11] D. Koller, K. Daniilidis, and H.-H. Nagel, "Model-based object tracking in monocular image sequence of road traffic scenes," Int'l J. Computer Vision, vol. 10, no. 3, pp. 257-281, 1993.
[12] J.Y.A. Wang and E.H. Adelson, Representing Moving Images with Layers IEEE Trans. Image Processing, vol. 3, no. 5, pp. 625-638, Sept. 1994.
[13] J.M. Rehg and T. Kanade, “Model-Based Tracking of Self-Occluding Articulated Objects,” Proc. Fifth Int'l Conf. Computer Vision, pp. 612–617, June 1995.
[14] D. Gavrila and L. Davis, “3-D Model-Based Tracking of Humans in Action: A Multi-View Approach,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1996.
[15] M. Isard and A. Blake, “Contour Tracking by Stochastic Propagation of Conditional Density,” Proc. European Conf. Computer Vision, pp. 343-356, 1996.
[16] F. Leymarie and M. Levine, "Tracking deformable objects in the plane using an active contour model, IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 6, pp. 617-634, June 1993.
[17] M. Kass, A. Witkin, and D. Terzopoulos, “Snakes: Active Contour Models,” Int'l J. Computer Vision, vol. 1, pp. 321-332, 1988.
[18] A. Blake and M. Isard, Active Contours. Springer-Verlag, 1997.
[19] L. D. Cohen,“On active contour models and balloons,” Computer Vision, Graphics, and Image Processing, vol. 53, No. 2, pp. 211-218, March 1991.
[20] V. Caselles, R. Kimmel, and G. Sapiro, “Geodesic Active Contours,” Proc. IEEE Int'l Conf. Computer Vision, 1995.
[21] S. Kichenassamy, A. Kumar, P. Olver, A. Tannenbaum, and A. Yezzi, Gradient Flows and Geometric Active Contour Models Proc. IEEE Int'l Conf. Computer Vision, pp. 810-815, 1995.
[22] R. Malladi, J. Sethian, and B.C. Vemuri, "Shape Modeling with Front Propagation: A Level Set Approach," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, pp. 158-175, 1995.
[23] D. Koller, J. Weber, and J. Malik, “Robust Multiple Car Tracking with Occlusion Reasoning,” Computer Vision-ECCV '94, J.-O. Eklundh, ed., vol. 1, pp. 189-196, 1994.
[24] V. Caselles and B. Coll, “Snakes in Movement,” SIAM J. Numerical Analysis, vol. 33, pp. 2,445-2,456, 1996.
[25] M.J. Black, "Combining Intensity and Motion for Incremental Segmentation and Tracking Over Long Image Sequences," Proc. Second European Conf. Computer Vision, ECCV-92, G. Sandini, ed., vol. 588of LNCS-Series, pp. 485-493. Springer-Verlag, May 1992.
[26] F. Heitz and P. Bouthemy, Multimodal Estimation of Discontinuous Optical Flow Using Markov Random Fields IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 12, pp. 1217-1232, Dec. 1993.
[27] M. Bertalmio, G. Sapiro, and G. Randall, “Morphing Active Contours,” Proc. Int'l Conf. Scale-Space Theories in Computer Vision, pp. 46-57, 1999.
[28] R. Goldenberg, R. Kimmel, E. Rivlin, and M. Rudzsky, “Fast Geodesic Active Contours,” Proc. Int'l Conf. Scale-Space Theories in Computer Vision, pp. 34-45, 1999.
[29] N. Paragios and R. Deriche, “A PDE-Based Level-Set Approach for Detection and Tracking of Moving Objects,” Proc. Int'l Conf. Computer Vision '98, Jan. 1998.
[30] S. Osher and J.A. Sethian, “Fronts Propagating with Curvature-Dependent Speed: Algorithms Based on Hamilton-Jacobi Formulations,” J. Computing in Physics, vol. 79, pp. 12-49, 1988.
[31] J. Sethian, Level Set Methods. Cambridge Univ. Press, 1996.
[32] D. Adalsteinsson and J. A. Sethian,“A fast level set method for propagating interfaces,” submitted for publication, J. of Computational Physics, 1994.
[33] O. Faugeras and R. Keriven, “Variational Principles, Surface Evolution, PDE's, Level Set Methods and the Stereo Problem,” IEEE Trans. Image Processing, vol. 7, no. 3, pp. 336-344, 1998.
[34] D. Terzopolous, A. Witkin, and M. Kass, "Constraints on deformable models: Recovering 3D shape and nonrigid motion, AI, no. 36, pp. 91-123, 1988.
[35] R. Deriche and O. Faugeras, “Les EDP en Traitement des Images et Vision par Ordinateur,” Traitement du Signal, vol. 13, 1996. ftp://ftp-robotvis.inria.fr/pub/html/Papers deriche-faugeras:96b.ps.gz.
[36] S. Kichenassamy, A. Kumar, P. Olver, A. Tannenbaum, and A. Yezzi, “Conformal Curvature Flows: From Phase Transitions to Active Vision,” Archive of Rational Mechanics and Analysis, vol. 134, pp. 275-301, 1996.
[37] D. L. Chopp,“Computing minimal surfaces via level set curvature flow,” J. of Computational Physics, vol. 106, pp. 77-91, 1993.
[38] J. Sethian, “A Fast Marching Level Set Method for MonotonicallyAdvancing Fronts,” Proc. Nat'l Academy of Science, vol. 93, pp. 1,591-1,694, 1996.
[39] J. Sethian, “A Review of Theory, Algorithms, and Applications of Level Set Methods for Propagating Interfaces,” Acta Numerica. Cambridge Univ. Press, 1996.
[40] T.H. Cormen,C.E. Leiserson, and R.L. Rivest,Introduction to Algorithms.Cambridge, Mass.: MIT Press/McGraw-Hill, 1990.
[41] R. Duda and P. Hart, Pattern Classification and Scene Analysis. John Wiley&Sons, 1973.
[42] N. Paragios and R. Deriche, ”Unifying Boundary and Region-Based Information for Geodesic Active Tracking,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 1999.
[43] N. Paragios and R. Deriche, “Geodesic Active Regions for Motion Estimation and Tracking,” Proc. Int'l Conf. Computer Vision, Sept. 1999.

Index Terms:
Front propagation, geodesic active contours, level set theory, motion detection, tracking.
Citation:
Nikos Paragios, Rachid Deriche, "Geodesic Active Contours and Level Sets for the Detection and Tracking of Moving Objects," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 3, pp. 266-280, March 2000, doi:10.1109/34.841758
Usage of this product signifies your acceptance of the Terms of Use.