The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.08 - August (2009 vol.31)
pp: 1458-1471
Tammy Riklin-Raviv , Massachusetts Institute of Technology, Cambridge
Nir Sochen , Tel Aviv University, Tel-Aviv
Nahum Kiryati , Tel Aviv University, Tel-Aviv
ABSTRACT
We introduce a novel variational method for the extraction of objects with either bilateral or rotational symmetry in the presence of perspective distortion. Information on the symmetry axis of the object and the distorting transformation is obtained as a by--product of the segmentation process. The key idea is the use of a flip or a rotation of the image to segment as if it were another view of the object. We call this generated image the symmetrical counterpart image. We show that the symmetrical counterpart image and the source image are related by planar projective homography. This homography is determined by the unknown planar projective transformation that distorts the object symmetry. The proposed segmentation method uses a level-set-based curve evolution technique. The extraction of the object boundaries is based on the symmetry constraint and the image data. The symmetrical counterpart of the evolving level-set function provides a dynamic shape prior. It supports the segmentation by resolving possible ambiguities due to noise, clutter, occlusions, and assimilation with the background. The homography that aligns the symmetrical counterpart to the source level-set is recovered via a registration process carried out concurrently with the segmentation. Promising segmentation results of various images of approximately symmetrical objects are shown.
INDEX TERMS
Symmetry, segmentation, level-sets, homography.
CITATION
Tammy Riklin-Raviv, Nir Sochen, Nahum Kiryati, "On Symmetry, Perspectivity, and Level-Set-Based Segmentation", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.31, no. 8, pp. 1458-1471, August 2009, doi:10.1109/TPAMI.2008.160
REFERENCES
[1] A. Bruckstein and D. Shaked, “Skew-Symmetry Detection via Invariant Signatures,” Pattern Recognition, vol. 31, no. 2, pp. 181-192, 1998.
[2] V. Caselles, R. Kimmel, and G. Sapiro, “Geodesic Active Contours,” Int'l J. Computer Vision, vol. 22, no. 1, pp. 61-79, Feb. 1997.
[3] T. Chan and L. Vese, “Active Contours without Edges,” IEEE Trans. Image Processing, vol. 10, no. 2, pp. 266-277, Feb. 2001.
[4] Y. Chen, H. Tagare, S. Thiruvenkadam, F. Huang, D. Wilson, K. Gopinath, R. Briggs, and E. Geiser, “Using Prior Shapes in Geometric Active Contours in a Variational Framework,” Int'l J. Computer Vision, vol. 50, no. 3, pp. 315-328, 2002.
[5] H. Cornelius and G. Loy, “Detecting Rotational Symmetry under Affine Projection,” Proc. Int'l Conf. Pattern Recognition, pp. 292-295, 2006.
[6] D. Cremers, “Dynamical Statistical Shape Priors for Level Set Based Tracking,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 8, pp. 1262-1273, Aug. 2006.
[7] D. Cremers, T. Kohlberger, and C. Schnorr, “Shape Statistics in Kernel Space for Variational Image Segmentation,” Pattern Recognition, vol. 36, no. 9, pp. 1929-1943, 2003.
[8] D. Cremers, S.J. Osher, and S. Soatto, “Kernel Density Estimation and Intrinsic Alignment for Shape Priors in Level Set Segmentation,” Int'l J. Computer Vision, vol. 69, no. 3, pp. 335-351, 2006.
[9] D. Cremers and S. Soatto, “A Pseudo-Distance for Shape Priors in Level Set Segmentation,” Proc. Second IEEE Workshop Variational, Geometric and Level Set Methods in Computer Vision, pp. 169-176, 2003.
[10] D. Cremers, N. Sochen, and C. Schnörr, “Multiphase Dynamic Labeling for Variational Recognition-Driven Image Segmentation,” Int'l J. Computer Vision, vol. 66, no. 1, pp. 67-81, 2006.
[11] A. Dervieux and F. Thomasset, “A Finite Element Method for the Simulation of Rayleigh-Taylor Instability,” Lecture Notes in Math., vol. 771, pp. 145-158, 1979.
[12] R. Fawcett, A. Zisserman, and J. Brady, “Extracting Structure from an Affine View of a 3D Point Set with One or 2 Bilateral Symmetries,” Image and Vision Computing, vol. 12, no. 9, pp. 615-622, Nov. 1994.
[13] J. Gauch and S. Pizer, “The Intensity Axis of Symmetry and Its Application to Image Segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 8, pp. 753-770, Aug. 1993.
[14] A. Gupta, V. Prasad, and L. Davis, “Extracting Regions of Symmetry,” Proc. Int'l Conf. Image Processing, pp. III:133-136, 2005.
[15] R.I. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, second ed. Cambridge Univ. Press, 2003.
[16] W. Hong, Y. Yang, and Y. Ma, “On Symmetry and Multiple View Geometry: Structure, Pose and Calibration from Single Image,” Int'l J. Computer Vision, vol. 60, pp. 241-265, 2004.
[17] H. Ishikawa, D. Geiger, and R. Cole, “Finding Tree Structures by Grouping Symmetries,” Proc. Int'l Conf. Computer Vision, pp. 1132-1139, 2005.
[18] K. Kanatani, “Symmetry as a Continuous Feature: Comment,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 3, pp. 246-247, Mar. 1997.
[19] Y. Keller and Y. Shkolnisky, “An Algebraic Approach to Symmetry Detection,” Proc. Int'l Conf. Pattern Recognition, pp.III:186-189, 2004.
[20] S. Kichenassamy, A. Kumar, P. Olver, A. Tannenbaum, and A. Yezzi, “Gradient Flows and Geometric Active Contour Models,” Proc. Int'l Conf. Computer Vision, pp. 810-815, 1995.
[21] R. Kimmel, “Fast Edge Integration,” Geometric Level Set Methods in Imaging Vision and Graphics, S. Osher and N. Paragios, eds., Springer-Verlag, 2003.
[22] R. Kimmel and A. Bruckstein, “Regularized Laplacian Zero Crossings as Optimal Edge Integrators,” Int'l J. Computer Vision, vol. 53, no. 3, pp. 225-243, 2003.
[23] N. Kiryati and Y. Gofman, “Detecting Symmetry in Grey Level Images: The Global Optimization Approach,” Int'l J. Computer Vision, vol. 29, no. 1, pp. 29-45, 1998.
[24] T. Kohlberger, D. Cremers, M. Rousson, and R. Ramaraj, “4D Shape Priors for Level Set Segmentation of the Left Myocardium in SPECT Sequences,” Medical Image Computing and Computer-Assisted Intervention, vol. 4190, pp. 92-100, Oct. 2006.
[25] A. Laird and J. Miller, “Hierarchical Symmetry Segmentation,” Proc. SPIE, Intelligent Robots and Computer Vision IX: Algorithms and Techniques, vol. 1381, pp. 536-544, Feb. 1991.
[26] M. Leventon, W. Grimson, and O. Faugeras, “Statistical Shape Influence in Geodesic Active Contours,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 316-323, 2000.
[27] T. Liu, D. Geiger, and A. Yuille, “Segmenting by Seeking the Symmetry Axis,” Proc. Int'l Conf. Pattern Recognition, pp. 994-998, 1998.
[28] L. Lorigo, O. Faugeras, W.E.L. Grimson, R. Keriven, R. Kikinis, A. Nabavi, and C. Westin, “Codimension Two-Geodesic Active Contours for the Segmentation of Tabular Structures,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 444-451, 2000.
[29] G. Marola, “On the Detection of the Axes of Symmetry of Symmetric and Almost Symmetric Planar Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 1, pp. 104-108, Jan. 1989.
[30] D. Milner, S. Raz, H. Hel-Or, D. Keren, and E. Nevo, “A New Measure of Symmetry and Its Application to Classification of Bifurcating Structures,” Pattern Recognition, vol. 40, pp. 2237-2250, 2007.
[31] D. Mukherjee, A. Zisserman, and J. Brady, “Shape from Symmetry—Detecting and Exploiting Symmetry in Affine Images,” Philosophical Trans. Royal Soc. of London, vol. 351, pp.77-106, 1995.
[32] D. Mumford and J. Shah, “Optimal Approximations by Piecewise Smooth Functions and Associated Variational Problems,” Comm. Pure and Applied Math., vol. 42, pp. 577-684, 1989.
[33] S. Osher and J. Sethian, “Fronts Propagating with Curvature-Dependent Speed: Algorithms Based on Hamilton-Jacobi Formulations,” J. Computational Physics, vol. 79, pp. 12-49, 1988.
[34] V. Prasad and L. Davis, “Detecting Rotational Symmetries,” Proc. Int'l Conf. Computer Vision, pp. 954-961, 2005.
[35] T. Riklin-Raviv, N. Kiryati, and N. Sochen, “Unlevel-Sets: Geometry and Prior-Based Segmentation,” Proc. European Conf. Computer Vision, vol. 4, pp. 50-61, 2004.
[36] T. Riklin-Raviv, N. Kiryati, and N. Sochen, “Prior-Based Segmentation by Projective Registration and Level Sets,” Proc. Int'l Conf. Computer Vision, vol. 1, pp. 204-211, 2005.
[37] T. Riklin-Raviv, N. Kiryati, and N. Sochen, “Segmentation by Level-Sets and Symmetry,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 1015-1022, 2006.
[38] T. Riklin-Raviv, N. Kiryati, and N. Sochen, “Prior-Based Segmentation and Shape Registration in the Presence of Projective Distortion,” Int'l J. Computer Vision, vol. 72, no. 3, pp. 309-328, 2007.
[39] T. Riklin-Raviv, N. Sochen, and N. Kiryati, “Shape-Based Mutual Segmentation,” Int'l J. Computer Vision, 2007, doi: 10.1007/s11263-007-0115-3.
[40] T. Riklin-Raviv, N. Sochen, and N. Kiryati, “Mutual Segmentation with Level-Sets,” Proc. Fifth IEEE CS Workshop Perceptual Organization in Computer Vision, 2006.
[41] M. Rousson and N. Paragios, “Shape Priors for Level Set Representation,” Proc. European Conf. Computer Vision, pp. 78-92, 2002.
[42] I. Shimshoni, Y. Moses, and M. Lindenbaum, “Shape Reconstruction of 3D Bilaterally Symmetric Surfaces,” Int'l J. Computer Vision, vol. 39, no. 2, pp. 97-110, 2000.
[43] J. Stahl and S. Wang, “Globally Optimal Grouping for Symmetric Boundaries,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 1030-1037, 2006.
[44] S. Tari and J. Shah, “Local Symmetries of Shapes in Arbitrary Dimension,” Proc. Int'l Conf. Computer Vision, pp. 1123-1128, 1998.
[45] D. Terzopoulos, A. Witkin, and M. Kass, “Symmetry-Seeking Models and 3D Object Reconstruction,” Int'l J. Computer Vision, vol. 1, pp. 211-221, 1987.
[46] S. Thrun and B. Wegbreit, “Shape from Symmetry,” Proc. Int'l Conf. Computer Vision, pp. 1824-1831, 2005.
[47] A. Tsai, A. Yezzi Jr., W. Wells III, C. Tempany, D. Tucker, A. Fan, W. Grimson, and A. Willsky, “A Shape-Based Approach to the Segmentation of Medical Imagery Using Level Sets,” IEEE Trans. Medical Imaging, vol. 22, no. 2, pp. 137-154, 2003.
[48] C. Tyler, Human Symmetry Perception and Its Computational Analysis. Lawrence Erlbaum Assoc., 2002.
[49] L. Van Gool, T. Moons, D. Ungureanu, and A. Oosterlinck, “The Characterization and Detection of Skewed Symmetry,” Computer Vision and Image Understanding, vol. 61, no. 1, pp. 138-150, 1995.
[50] L. Van Gool, T. Moons, D. Ungureanu, and E. Pauwels, “Symmetry from Shape and Shape from Symmetry,” Int'l J. Robotics Research, vol. 14, no. 5, pp. 407-424, 1995.
[51] A. Vasilevskiy and K. Siddiqi, “Flux Maximizing Geometric Flows,” Proc. Int'l Conf. Computer Vision, pp. 149-154, 2001.
[52] L. Vese and T. Chan, “A Multiphase Level Set Framework for Image Segmentation Using Mumford and Shah Model,” Int'l J. Computer Vision, vol. 50, no. 3, pp. 271-293, 2002.
[53] Y. Yang, K. Huang, S. Rao, W. Hong, and Y. Ma, “Symmetry-Based 3-D Reconstruction from Perspective Images,” Computer Vision and Image Understanding, vol. 99, pp. 210-240, 2005.
[54] Y. Yang, S. Rao, K. Huang, W. Hong, and Y. Ma, “Geometric Segmentation of Perspective Images Based on Symmetry Groups,” Proc. Int'l Conf. Computer Vision, vol. 2, pp. 1251-1258, 2003.
[55] H. Zabrodsky, S. Peleg, and D. Avnir, “Completion of Occluded Shapes Using Symmetry,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 678-679, June 1993.
[56] H. Zabrodsky, S. Peleg, and D. Avnir, “Symmetry as a Continuous Feature,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 12, pp. 1154-1166, Dec. 1995.
[57] H. Zabrodsky and D. Weinshall, “Using Bilateral Symmetry to Improve 3D Reconstruction from Image Sequences,” Computer Vision and Image Understanding, vol. 67, pp. 48-57, 1997.
18 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool