• Publication
  • 2006
  • Issue No. 5 - May
  • Abstract - Joint Multiregion Segmentation and Parametric Estimation of Image Motion by Basis Function Representation and Level Set Evolution
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Joint Multiregion Segmentation and Parametric Estimation of Image Motion by Basis Function Representation and Level Set Evolution
May 2006 (vol. 28 no. 5)
pp. 782-793
The purpose of this study is to investigate a variational method for joint segmentation and parametric estimation of image motion by basis function representation of motion and level set evolution. The functional contains three terms. One term is of classic regularization to bias the solution toward a segmentation with smooth boundaries. A second term biases the solution toward a segmentation with boundaries which coincide with motion discontinuities, following a description of motion discontinuities by a function of the image spatio-temporal variations. The third term refers to region information and measures conformity of the parametric representation of the motion of each region of segmentation to the image spatio-temporal variations. The components of motion in each region of segmentation are represented as functions in a space generated by a set of basis functions. The coefficients of the motion components considered combinations of the basis functions are the parameters of representation. The necessary conditions for a minimum of the functional, which are derived taking into consideration the dependence of the motion parameters on segmentation, lead to an algorithm which condenses to concurrent curve evolution, implemented via level sets, and estimation of the parameters by least squares within each region of segmentation. The algorithm and its implementation are verified on synthetic and real images using a basis of cosine transforms.

[1] A. Kaup, “Object-Based Texture Coding of Moving Video in MPEG-4,” IEEE Trans. Circuits Systems Video Technology, vol. 9, no. 1, pp. 5-15, Feb. 1999.
[2] A. Mitiche, Computational Analysis of Visual Motion. Kluwer Academic, 1994.
[3] T. Wiegand, G. Sullivan, G. Bjøntegaard, and A. Luthra, “Overview of the H. 264/AVC Video Coding Standard,” IEEE Trans. Circuits Systems Video Technology, vol. 13, no. 7, pp. 560-576, July 2003.
[4] R. Deriche, P. Kornprobst, and G. Aubert, “Optical-Flow Estimation while Preserving Its Discontinuities: A Variational Approach,” Proc. Second Asian Conf. Computer Vision, vol. 2, pp. 290-295, Dec. 1995.
[5] T. Brox, A. Bruhn, N. Papenberg, and J. Weickert, “High Accuracy Optical Flow Estimation Based on a Theory of Warping,” Proc. European Conf. Computer Vision, vol. 4, pp. 25-36, May 2004.
[6] C. Bergeron and E. Dubois, “Gradient Based Algorithms for Block Oriented MAP Estimation of Motion and Application to Motion-Compensated Temporal Interpolation,” IEEE Trans. Circuits Systems Video Technology, vol. 1, pp. 72-85, Mar. 1991.
[7] J. Odobez and P. Bouthemy, “Robust Multiresolution Estimation of Parametric Motion Models,” J. Visual Comm. and Image Representation, vol. 6, no. 4, pp. 348-365, Dec. 1995.
[8] Y. Altunbasak, R. Mersereau, and A. Patti, “A Fast Parametric Motion Estimation Algorithm with Illumination and Lens Distortion Correction,” IEEE Trans. Image Processing, vol. 12, no. 4, pp. 395-408, Apr. 2003.
[9] N. Diehl, “Object-Oriented Motion Estimation and Segmentation in Image Sequences,” Signal Processing: Image Comm., vol. 3, no. 1, pp. 23-56, Feb. 1991.
[10] F. Dufaux, I. Moccagatta, F. Moscheni, and H. Nicolas, “Vector Quantization-Based Motion Field Segmentation under the Entropy Criterion,” J. Visual Comm. and Image Representation, vol. 5, pp. 356-369, Dec. 1994.
[11] J. Wang and E. Adelson, “Representing Moving Images with Layers,” IEEE Trans. Image Processing, vol. 3, no. 5, pp. 625-638, Sept. 1994.
[12] G. Borshukov, G. Bozdagi, Y. Altunbasak, and A. Tekalp, “Motion Segmentation by Multistage Affine Classification,” IEEE Trans. Image Processing, vol. 6, no. 11, pp. 1591-1594, 1997.
[13] M. Chang, A. Tekalp, and M. Sezan, “Simultaneous Motion Estimation and Segmentation,” IEEE Trans. Image Processing, vol. 6, no. 9, pp. 1326-1333, Sept. 1997.
[14] A.-R. Mansouri and J. Konrad, “Multiple Motion Segmentation with Level Sets,” IEEE Trans. Image Processing, vol. 12, no. 2, pp. 201-220, Feb. 2003.
[15] A. Mansouri, A. Mitiche, and C. Langevin, “Joint Space-Time Motion-Based Segmentation of Image Sequences with Level Set PDEs,” Proc. IEEE Workshop Motion and Video Computing, pp. 50-55, Dec. 2002.
[16] A.-R. Mansouri, A. Mitiche, and F. Dolla, “Motion-Based Figure-Ground Segmentation by Maximum Motion Separation,” Proc. IEEE Int'l Conf. Image Processing, Sept. 2003.
[17] D. Cremers and S. Soatto, “Variational Space-Time Motion Segmentation,” Proc. IEEE Int'l Conf. Computer Vision, pp. 886-892, Oct. 2003.
[18] D. Mumford and J. Shah, “Optimal Approximations by Piecewise Smooth Functions and Associated Variational-Problems,” Comm. Pure Applied Math., vol. 42, no. 5, pp. 577-685, July 1989.
[19] G. Aubert, M. Barlaud, O. Faugeras, and S. Jehan-Besson, “Image Segmentation Using Active Contours: Calculus of Variations or Shape Gradients?” SIAM J. Applied Math., vol. 63, no. 6, pp. 2128-2154, 2003.
[20] D. Cremers, “A Multiphase Level Set Framework for Motion Segmentation,” Proc. Int'l Conf. Scale-Space Theories in Computer Vision, pp. 599-614, June 2003.
[21] S. Zhu and A. Yuille, “Region Competition: Unifiying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation,” IEEE Trans. Pattern Analysis Machine Intelligence, vol. 18, no. 9, pp. 884-900, Sept. 1996.
[22] C. Stiller and J. Konrad, “Estimating Motion in Image Sequences: A Tutorial on Modeling and Computation of 2D Motion,” IEEE Signal Processing Magazine, vol. 16, no. 4, pp. 70-91, July 1999.
[23] A.-R. Mansouri, A. Mitiche, and C. Vázquez, “Image Portioning by Level Set Multiregion Competition,” Proc. IEEE Int'l Conf. Image Processing, Oct. 2004.
[24] B. Horn and B. Schunck, “Determining the Optical Flow,” Artificial Intelligence, vol. 17, pp. 185-203, 1981.
[25] A. Mitiche, R. Feghali, and A. Mansouri, “Motion Tracking as Spatio-Temporal Motion Boundary Detection,” J. Robotics and Autonomous Systems, vol. 43, pp. 39-50, 2003.
[26] T. Chan and L. Vese, “Active Contours without Edges,” IEEE Trans. Image Processing, vol. 10, no. 2, pp. 266-277, Feb. 2001.
[27] G. Aubert and P. Kornprobst, Mathematical Problems in Image Processing. Springer Verlag, 2002.
[28] J. Sethian, Level Set Methods and Fast Marching Methods, second ed. Cambridge Univ. Press, 1999.
[29] C. Vázquez, A. Mitiche, and I. BenAyed, “Segmentation of Vectorial Images by a Global Curve Evolution Method,” Proc. Reconnaissance des Formes et Intelligence Artificielle, RFIA-04, Jan. 2004.
[30] S. Mallat, A Wavelet Tour of Signal Processing, first ed. Academic Press, 1998.
[31] J. Odobez and P. Bouthemy, “Direct Incremental Model-Based Image Motion Segmentation for Video Analysis,” Signal Processing, vol. 6, no. 2, pp. 143-155, 1998.
[32] C. Vázquez, A.-R. Mansouri, and A. Mitiche, “Approximation of Images by Basis Functions for Multiple Region Segmentation with Level Sets,” Proc. IEEE Int'l Conf. Image Processing, pp. 549-552, Oct. 2004.
[33] B. Sandberg, T. Chan, and L. Vese, “A Level-Set and Gabor-Based Active Contour Algorithm for Segmenting Textured Images,” Technical Report CAM Report 02-39, Univ. of California, Los Angeles, July 2002.
[34] S. Zhu and D. Mumford, “Minimax Entropy Principle and Its Application to Texture Modeling,” Neural Computation, vol. 9, no. 8, 1997.

Index Terms:
Motion estimation, motion segmentation, basis function representation of motion, parametric motion model, curve evolution, level sets.
Citation:
Carlos V?zquez, Amar Mitiche, Robert Lagani?re, "Joint Multiregion Segmentation and Parametric Estimation of Image Motion by Basis Function Representation and Level Set Evolution," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 5, pp. 782-793, May 2006, doi:10.1109/TPAMI.2006.97
Usage of this product signifies your acceptance of the Terms of Use.