This Article 
 Bibliographic References 
 Add to: 
Spectral Symmetry Analysis
July 2010 (vol. 32 no. 7)
pp. 1227-1238
Michael Chertok, Bar-Ilan University, Israel
Yosi Keller, Bar-Ilan University, Israel
We present a spectral approach for detecting and analyzing rotational and reflectional symmetries in n-dimensions. Our main contribution is the derivation of a symmetry detection and analysis scheme for sets of points in {{\hbox{\rlap{I}\kern 2.0pt{\hbox{R}}}}}^{n} and its extension to image analysis by way of local features. Each object is represented by a set of points S\in {{\hbox{\rlap{I}\kern 2.0pt{\hbox{R}}}}}^{n}, where the symmetry is manifested by the multiple self-alignments of S. The alignment problem is formulated as a quadratic binary optimization problem, with an efficient solution via spectral relaxation. For symmetric objects, this results in a multiplicity of eigenvalues whose corresponding eigenvectors allow the detection and analysis of both types of symmetry. We improve the scheme's robustness by incorporating geometrical constraints into the spectral analysis. Our approach is experimentally verified by applying it to 2D and 3D synthetic objects as well as real images.

[1] M.A. Arbib, The Handbook of Brain Theory and Neural Networks. MIT Press, 1995.
[2] H. Cornelius, M. Perdoch, J. Matas, and G. Loy, "Efficient Symmetry Detection Using Local Affine Frames," Proc. 15th Scandinavian Conf. Image Analysis, pp. 152-161, June 2007.
[3] S. Derrode and F. Ghorbel, "Shape Analysis and Symmetry Detection in Gray-Level Objects Using the Analytical Fourier-Mellin Representation," Signal Processing, vol. 84, no. 1, pp. 25-39, Jan. 2004.
[4] M.M. Kazhdan, B. Chazelle, D.P. Dobkin, A. Finkelstein, and T.A. Funkhouser, "A Reflective Symmetry Descriptor," Proc. Seventh European Conf. Computer Vision—Part II, pp. 642-656, 2002.
[5] N. Kiryati and Y. Gofman, "Detecting Symmetry in Grey Level Images: The Global Optimization Approach," Int'l J. Computer Vision, vol. 29, no. 1, pp. 29-45, Aug. 1998.
[6] G. Loy and J.-O. Eklundh, "Detecting Symmetry and Symmetric Constellations of Features," Proc. European Conf. Computer Vision, pp. 508-521, May 2006.
[7] L. Lucchese, "Frequency Domain Classification of Cyclic and Dihedral Symmetries of Finite 2D Patterns," Pattern Recognition, vol. 37, pp. 2263-2280, 2004.
[8] D. Reisfeld, H. Wolfson, and Y. Yeshurun, "Context Free Attentional Operators: The Generalized Symmetry Transform," Int'l J. Computer Vision, pp. 119-130, 1995.
[9] D. Shen, H. Ip, and E.K. Teoh, "Robust Detection of Skewed Symmetries by Combining Local and Semi-Local Affine Invariants," Pattern Recognition, vol. 34, no. 7, pp. 1417-1428, 2001.
[10] L. Shiv Naga Prasad and V. Davis, "Detecting Rotational Symmetries," Proc. 10th IEEE Int'l Conf. Computer Vision, vol. 2, pp. 954-961, Oct. 2005.
[11] M. Park, S. Lee, P.-C. Chen, S. Kashyap, A.A. Butt, and Y. Liu, "Performance Evaluation of State-of-the-Art Discrete Symmetry Detection Algorithms," Proc. Computer Vision and Pattern Recognition Conf., June 2008.
[12] M. Leordeanu and M. Hebert, "A Spectral Technique for Correspondence Problems Using Pairwise Constraints," Proc. Int'l Conf. Computer Vision, vol. 2, pp. 1482-1489, Oct. 2005.
[13] D. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," Int'l J. Computer Vision, vol. 20, pp. 91-110, 2003.
[14] C. Schmid and R. Mohr, "Local Grayvalue Invariants for Image Retrieval," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 5, pp. 530-535, May 1997.
[15] H.S.M. Coxeter, Introduction to Geometry. John Wiley & Sons, 1969.
[16] H. Weyl, Symmetry. Princeton Univ. Press, 1952.
[17] E. Trucco and A. Verri, Introductory Techniques for 3D Computer Vision, pp. 333-334. Prentice-Hall, 1998.
[18] W. Miller, Symmetry Groups and Their Applications. Academic Press, 1972.
[19] S. Chen, "Extraction of Local Mirror-Symmetric Feature by Odd-Even Decomposition," Proc. Int'l Conf. Image Processing, vol. 3, pp. 756-759, 2001.
[20] W. Kim and Y. Kim, "Robust Rotation Angle Estimator," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 8, pp. 768-773, Aug. 1999.
[21] Y. Keller and Y. Shkolnisky, "A Signal Processing Approach to Symmetry Detection," IEEE Trans. Image Processing, vol. 15, no. 6, pp. 2198-2207, Aug. 2006.
[22] S. Lee, R. Collins, and Y. Liu, "Rotation Symmetry Group Detection via Frequency Analysis of Frieze-Expansions," Proc. IEEE Computer Vision and Pattern Recognition Conf., June 2008.
[23] Y. Lei and K. Wong, "Detection and Localisation of Reflectional and Rotational Symmetry under Weak Perspective Projection," Pattern Recognition, vol. 32, no. 2, pp. 167-180, Feb. 1999.
[24] H. Zabrodsky, S. Peleg, and D. Avnir, "Symmetry as a Continuous Feature," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 12, pp. 1154-1166, Dec. 1995.
[25] V.S.N. Prasad and B. Yegnanarayana, "Finding Axes of Symmetry from Potential Fields," IEEE Trans. Image Processing, vol. 13, no. 12, pp. 1559-1566, Dec. 2004.
[26] A. Martinet, C. Soler, N. Holzschuch, and F. Sillion, "Accurate Detection of Symmetries in 3D Shapes," ACM Trans. Graphics, vol. 25, no. 2, pp. 439-464, Apr. 2006.
[27] T. Ojala, M. Pietikäinen, and T. Mäenpää, "Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 971-987, July 2002.
[28] J.H. Hays, M. Leordeanu, A.A. Efros, and Y. Liu, "Discovering Texture Regularity via Higher-Order Matching," Proc. Ninth European Conf. Computer Vision, pp. 522-535, May 2006.
[29] J. Zhang, M. Marszalek, S. Lazebnik, and C. Schmid, "Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study," Int'l J. Computer Vision, vol. 73, no. 2, pp. 213-238, 2007.
[30] M. Brown and D.G. Lowe, "Recognising Panoramas," Proc. IEEE Int'l Conf. Computer Vision, vol. 2, pp. 1218-1227, 2003.
[31] F. Tang and H. Tao, "Object Tracking with Dynamic Feature Graph," Proc. Performance Evaluation and Tracking of Surveillance, pp. 25-32, 2005.
[32] K. Mikolajczyk and C. Schmid, "Scale and Affine Invariant Interest Point Detectors," Int'l J. Computer Vision, vol. 60, no. 1, pp. 63-86, Oct. 2004.
[33] K. Mikolajczyk, T. Tuytelaars, C. Schmid, A. Zisserman, J. Matas, F. Schaffalitzky, T. Kadir, and L. Van Gool, "A Comparison of Affine Region Detectors," Int'l J. Computer Vision, vol. 65, nos. 1/2, pp. 43-72, 2005.
[34] J. Matas, O. Chum, M. Urban, and T. Pajdla, "Robust Wide Baseline Stereo from Maximally Stable Extremal Regions," Proc. British Machine Vision Conf., pp. 384-393, 2002.
[35] M.-E. Nilsback and A. Zisserman, "A Visual Vocabulary for Flower Classification," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
[36] G. Scott and H. Longuet Higgins, "An Algorithm for Associating the Features of Two Images," Proc. Royal Soc. London, vol. B-244, pp. 21-26, 1991.
[37] A.C. Berg, T.L. Berg, and J. Malik, "Shape Matching and Object Recognition Using Low Distortion Correspondences," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 26-33, June 2005.
[38] J. Shi and J. Malik, "Normalized Cuts and Image Segmentation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 888-905, Aug. 2000.
[39] T. Cour, P. Srinivasan, and J. Shi, "Balanced Graph Matching," Advances in Neural Information Processing Systems, B. Schölkopf, J. Platt, and T. Hoffman, eds., vol. 19, pp. 313-320, MIT Press, 2007.
[40] Y. Eldar, M. Lindenbaum, M. Porat, and Y. Zeevi, "The Farthest Point Strategy for Progressive Image Sampling," IEEE Trans. Image Processing, vol. 6, no. 9, pp. 1305-1315, Sept. 1997.
[41] R.I. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, second ed. Cambridge Univ. Press, 2004.
[42] M. Fischler and R. Bolles, "Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography," Comm. ACM, vol. 24, no. 6, pp. 381-395, June 1981.
[43] "Bioid, the Bioid Face Database," downloadsfacedb /, 2001.
[44] M. Valstar and M. Pantic, "Fully Automatic Facial Action Unit Detection and Temporal Analysis," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 3, May 2006.

Index Terms:
Computer vision, symmetry detection, optimization, spectral relaxation.
Michael Chertok, Yosi Keller, "Spectral Symmetry Analysis," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, no. 7, pp. 1227-1238, July 2010, doi:10.1109/TPAMI.2009.121
Usage of this product signifies your acceptance of the Terms of Use.