This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Dynamical Statistical Shape Priors for Level Set-Based Tracking
August 2006 (vol. 28 no. 8)
pp. 1262-1273
In recent years, researchers have proposed introducing statistical shape knowledge into level set-based segmentation methods in order to cope with insufficient low-level information. While these priors were shown to drastically improve the segmentation of familiar objects, so far the focus has been on statistical shape priors which are static in time. Yet, in the context of tracking deformable objects, it is clear that certain silhouettes (such as those of a walking person) may become more or less likely over time. In this paper, we tackle the challenge of learning dynamical statistical models for implicitly represented shapes. We show how these can be integrated as dynamical shape priors in a Bayesian framework for level set-based image sequence segmentation. We assess the effect of such shape priors "with memory” on the tracking of familiar deformable objects in the presence of noise and occlusion. We show comparisons between dynamical and static shape priors, between models of pure deformation and joint models of deformation and transformation, and we quantitatively evaluate the segmentation accuracy as a function of the noise level and of the camera frame rate. Our experiments demonstrate that level set-based segmentation and tracking can be strongly improved by exploiting the temporal correlations among consecutive silhouettes which characterize deforming shapes.

[1] H. Akaike, “Autoregressive Model Fitting for Control,” Annals Inst. Statistical Math., vol. 23, pp. 163-180, 1971.
[2] A. Blake, B. Bascle, M. Isard, and J. MacCormick, “Statistical Models of Visual Shape and Motion,” Philosophical Trans. Royal Soc. London, A, vol. 356, pp. 1283-1302, 1998.
[3] A. Blake and M. Isard, Active Contours. Springer, 1998.
[4] V. Caselles, R. Kimmel, and G. Sapiro, “Geodesic Active Contours,” Proc. IEEE Int'l Conf. Computer Vision, pp. 694-699, 1995.
[5] T.F. Chan and L.A. Vese, “Active Contours without Edges,” IEEE Trans. Image Processing, vol. 10, no. 2, pp. 266-277, 2001.
[6] Y. Chen, H. Tagare, S. Thiruvenkadam, F. Huang, D. Wilson, K.S. Gopinath, R.W. Briggs, and E. Geiser, “Using Shape Priors in Geometric Active Contours in a Variational Framework,” Int'l J. Computer Vision, vol. 50, no. 3, pp. 315-328, 2002.
[7] D. Cremers and G. Funka-Lea, “Dynamical Statistical Shape Priors for Level Set Based Tracking,” Proc. Int'l Workshop Variational and Level Set Methods, N. Paragios et al., eds., vol. 3752, pp. 210-221, 2005.
[8] D. Cremers, T. Kohlberger, and C. Schnörr, “Nonlinear Shape Statistics in Mumford-Shah Based Segmentation,” Proc. European Conf. Computer Vision, May 2002.
[9] D. Cremers, S.J. Osher, and S. Soatto, “Kernel Density Estimation and Intrinsic Alignment for Shape Priors in Level Set Segmentation,” Int'l J. Computer Vision, 2006.
[10] D. Cremers, N. Sochen, and C. Schnörr, “A Multiphase Dynamic Labeling Model for Variational Recognition-Driven Image Segmentation,” Int'l J. Computer Vision, vol. 66, no. 1, pp. 67-81, 2006.
[11] A. Dervieux and F. Thomasset, “A Finite Element Method for the Simulation of Raleigh-Taylor Instability,” Springer Lecture Notes in Math., vol. 771, pp. 145-158, 1979.
[12] R. Goldenberg, R. Kimmel, E. Rivlin, and M. Rudzsky, “Behavior Classification by Eigendecomposition of Periodic Motion,” Pattern Recognition, vol. 38, pp. 1033-1043, July 2005.
[13] S. Kichenassamy, A. Kumar, P.J. Olver, A. Tannenbaum, and A.J. Yezzi, “Gradient Flows and Geometric Active Contour Models,” Proc. IEEE Int'l Conf. Computer Vision, pp. 810-815, 1995.
[14] V. Kolmogorov and R. Zabih, “What Energy Functions Can Be Minimized via Graph Cuts?” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 657-673, May 2004.
[15] M. Leventon, W. Grimson, and O. Faugeras, “Statistical Shape Influence in Geodesic Active Contours,” Proc. Int'l Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 316-323, 2000.
[16] L. Ljung, System Identification— Theory for the User. Prentice Hall, 1999.
[17] R. Malladi, J.A. Sethian, and B.C. Vemuri, “Shape Modeling with Front Propagation: A Level Set Approach,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 2, pp. 158-175, Feb. 1995.
[18] M. Moelich and T. Chan, “Tracking Objects with the Chan-Vese Algorithm,” Technical Report 03-14, Computational Applied Math., Univ. of California at Los Angeles, 2003.
[19] D. Mumford and J. Shah, “Optimal Approximations by Piecewise Smooth Functions and Associated Variational Problems,” Comm. Pure Applied Math., vol. 42, pp. 577-685, 1989.
[20] A. Neumaier and T. Schneider, “Estimation of Parameters and Eigenmodes of Multivariate Autoregressive Models,” ACM Trans. Math. Software, vol. 27, no. 1, pp. 27-57, 2001.
[21] S.J. Osher and J.A. Sethian, “Fronts Propagation with Curvature Dependent Speed: Algorithms Based on Hamilton-Jacobi Formulations,” J. Computational Physics, vol. 79, pp. 12-49, 1988.
[22] A. Papoulis, Probability, Random Variables, and Stochastic Processes. McGraw-Hill, 1984.
[23] N. Paragios and R. Deriche, “Geodesic Active Regions and Level Set Methods for Supervised Texture Segmentation,” Int'l J. Computer Vision, vol. 46, no. 3, pp. 223-247, 2002.
[24] Y. Rathi, N. Vaswani, A. Tannenbaum, and A. Yezzi, “Particle Filtering for Geometric Active Contours and Application to Tracking Deforming Objects,” IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 2-9, 2005.
[25] T. Riklin-Raviv, N. Kiryati, and N. Sochen, “Unlevel Sets: Geometry and Prior-Based Segmentation,” Proc. European Conf. Computer Vision, 2004.
[26] M. Rousson and D. Cremers, “Efficient Kernel Density Estimation of Shape and Intensity Priors for Level Set Segmentation,” Proc. Int'l Conf. Medical Image Computing and Computer-Assisted Intervention, vol. 1, pp. 757-764, 2005.
[27] M. Rousson and N. Paragios, “Shape Priors for Level Set Representations,” Proc. European Conf. Computer Vision, 2002.
[28] M. Rousson, N. Paragios, and R. Deriche, “Implicit Active Shape Models for 3D Segmentation in MRI Imaging,” Proc. Int'l Conf. Medical Image Computing and Computer-Assisted Intervention, pp. 209-216, 2004.
[29] G. Schwarz, “Estimating the Dimension of a Model,” Annals Statistics, vol. 6, pp. 461-464, 1978.
[30] A. Tsai, A. Yezzi, W. Wells, C. Tempany, D. Tucker, A. Fan, E. Grimson, and A. Willsky, “Model-Based Curve Evolution Technique for Image Segmentation,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 463-468, 2001.
[31] A. Tsai, A.J. Yezzi, and A.S. Willsky, “Curve Evolution Implementation of the Mumford-Shah Functional for Image Segmentation, Denoising, Interpolation, and Magnification,” IEEE Trans. Image Processing, vol. 10, no. 8, pp. 1169-1186, 2001.
[32] S.C. Zhu and A. Yuille, “Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 9, pp. 884-900, Sept. 1996.
[33] V. Caselles, F. Catté, T. Coll, and F. Dibos, “A Geometric Model for Active Contours in Image Processing,” Numerical Math., vol. 66, pp. 1-31, 1993.
[34] D. Cremers, M. Rousson, and R. Deriche, “A Review of Statistical Approaches to Level Set Segmentation: Integrating Color, Texture, Motion and Shape,” Int'l J. Computer Vision, to appear.

Index Terms:
Variational methods, statistical shape models, autoregressive models, level sets, tracking.
Citation:
Daniel Cremers, "Dynamical Statistical Shape Priors for Level Set-Based Tracking," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 8, pp. 1262-1273, Aug. 2006, doi:10.1109/TPAMI.2006.161
Usage of this product signifies your acceptance of the Terms of Use.