CSDL Home IEEE Transactions on Pattern Analysis & Machine Intelligence 2012 vol.34 Issue No.02 - February

Subscribe

Issue No.02 - February (2012 vol.34)

pp: 266-278

Seungkyu Lee , Adv. Media Lab., Samsung Adv. Inst. of Technol. (SALT), Yongin, South Korea

Yanxi Liu , Dept. of Comput. Sci. & Electr. Eng., Pennsylvania State Univ., University Park, PA, USA

ABSTRACT

We generalize the concept of bilateral reflection symmetry to curved glide-reflection symmetry in 2D euclidean space, such that classic reflection symmetry becomes one of its six special cases. We propose a local feature-based approach for curved glide-reflection symmetry detection from real, unsegmented 2D images. Furthermore, we apply curved glide-reflection axis detection for curved reflection surface detection in 3D images. Our method discovers, groups, and connects statistically dominant local glide-reflection axes in an Axis-Parameter-Space (APS) without preassumptions on the types of reflection symmetries. Quantitative evaluations and comparisons against state-of-the-art algorithms on a diverse 64-test-image set and 1,125 Swedish leaf-data images show a promising average detection rate of the proposed algorithm at 80 and 40 percent, respectively, and superior performance over existing reflection symmetry detection algorithms. Potential applications in computer vision, particularly biomedical imaging, include saliency detection from unsegmented images and quantification of deviations from normality. We make our 64-test-image set publicly available.

INDEX TERMS

image segmentation, computer vision, feature extraction, saliency detection, curved glide reflection symmetry detection, bilateral reflection symmetry, 2D euclidean space, feature based approach, unsegmented 2D images, axis parameter space, APS, computer vision, biomedical imaging, Three dimensional displays, Detection algorithms, Feature extraction, Computer vision, Image edge detection, Algorithm design and analysis, curved surface., Symmetry, glide reflection, curved axis

CITATION

Seungkyu Lee, Yanxi Liu, "Curved Glide-Reflection Symmetry Detection",

*IEEE Transactions on Pattern Analysis & Machine Intelligence*, vol.34, no. 2, pp. 266-278, February 2012, doi:10.1109/TPAMI.2011.118REFERENCES

- [1] P. Locher and C. Nodine, "Symmetry Catches the Eye,"
Eye Movements: From Physiology to Cognition, J. O'Regan, and A. Levy-Schoen, eds., Elsevier Science Publishers B.V., 1987.- [2] G. Kootstra, A. Nederveen, and B. de Boer, "Paying Attention to Symmetry,"
Proc. British Machine Vision Conf., pp. 1115-1125, Sept. 2008.- [3] G. Heidemann, "Focus-of-Attention from Local Color Symmetries,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 7, pp. 817-830, July 2004.- [4] D. Reisfeld, H. Wolfson, and Y. Yeshurun, "Context Free Attentional Operators: The Generalized Symmetry Transform,"
Int'l J. Computer Vision, vol. 14, pp. 119-130, 1995.- [5] Y. Liu, H. Hel-Or, C.S. Kaplan, and L.V. Gool, "Computational Symmetry in Computer Vision and Computer Graphics,"
Foundations and Trends in Computer Graphics and Vision, vol. 5, pp. 1-195, 2010.- [6] H. Weyl,
Symmetry. Princeton Univ. Press, 1952.- [7] T.J. Christopher,
Compactifications of Symmetric Spaces. Birkhauser, 1997.- [8] S. Mitra and Y. Liu, "Local Facial Asymmetry for Expression Classification,"
Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 889-894, June 2004.- [9] A. Kuehnle, "Symmetry-Based Recognition of Vehicle Rears,"
Pattern Recognition Letters, vol. 12, no. 4, pp. 249-258, 1991.- [10] B. Dai, Y. Fu, and T. Wu, "A Vehicle Detection Method via Symmetry in Multi-Scale Windows,"
Proc. Second IEEE Conf. Industrial Electronics and Applications, pp. 1827-1831, May 2007.- [11] M. Mancas, B. Gosselin, and B. Macq, "Fast and Automatic Tumoral Area Localisation Using Symmetry,"
Proc. IEEE Int'l Conf. Acoustics, Speech, and Signal Processing, vol. 2, pp. 725-728, 2005.- [12] X. Yang, J. Pei, and W. Xie, "Rotation Registration of Medical Images Based on Image Symmetry,"
Advances in Intelligent Computing, vol. 3644, pp. 68-76, Springer, May 2005.- [13] Y. Liu, R. Collins, and W.E. Rothfus, "Robust Midsagittal Plane Extraction from Normal and Pathological 3D Neuroradiology Images,"
IEEE Trans. Medical Imaging, vol. 20, no. 3, pp. 175-192, Mar. 2001.- [14] Y. Liu, R. Collins, and Y. Tsin, "A Computational Model for Periodic Pattern Perception Based on Frieze and Wallpaper Groups,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 3, pp. 354-371, Mar. 2004.- [15] G. Loy and J. Eklundh, "Detecting Symmetry and Symmetric Constellations of Features,"
Proc. European Conf. Computer Vision, pp. 508-521, 2006.- [16] H. Peng, F. Long, X. Liu, S.K. Kim, and E.W. Myers, "Straightening c. Elegans Images,"
Bioinformatics, vol. 24, pp. btm569-242, Nov. 2007.- [17] G.D. Birkoff and O.D. Kellogg,
"Aesthetic Measure. Harvard Univ. Press, 1932.- [18] T. Kanade, "Recovery of the Three-Dimensional Shape of an Object from a Single View,"
Artificial Intelligence, vol. 17, pp. 409-460, 1981.- [19] J. Wolter, T. Woo, and R. Volz, "Optimal Algorithms for Symmetry Detection in Two and Three Dimensions,"
Visual Computer, vol. 1, pp. 37-48, 1985.- [20] G. Marola, "On the Detection of the Axes of Symmetry of Symmetric and Almost Symmetric Planar Images,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 1, pp. 104-108, Jan. 1989.- [21] P. Saint-marc and G. Medioni, "B-Spline Contour Representation and Symmetry Detection,"
Proc. European Conf. Computer Vision, pp. 604-606, 1990.- [22] J. Ponce, "On Characterizing Ribbons and Finding Skewed Symmetries,"
Computer Vision Graphics and Image Processing, vol. 52, pp. 328-340, Oct. 1990.- [23] Y. Liu, "Symmetry Groups in Robotic Assembly Planning," doctoral dissertation, Univ. of Massachusetts Amherst, Sept. 1990.
- [24] T. Zielke, M. Brauckmann, and W. Seelen, "Intensity and Edge-Based Symmetry Detection Applied to Car-Following,"
Proc. European Conf. Computer Vision, pp. 865-873, 1992.- [25] F. Labonte, Y. Shapira, and P. Cohen, "A Perceptually Plausible Model for Global Symmetry Detection,"
Proc. Fourth IEEE Int'l Conf. Computer Vision, pp. 258-263, May 1993.- [26] Y. Liu and R. Popplestone, "A Group Theoretic Formalization of Surface Contact,"
Int'l J. Robotics Research, vol. 13, no. 1, pp. 148-161, Apr. 1994.- [27] H. Zabrodsky, S. Peleg, and D. Avnir, "Symmetry as a Continuous Feature,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 12, pp. 1154-1166, Dec. 1995.- [28] D.P. Mukherjee, A. Zisserman, and M. Brady, "Shape from Symmetry: Detecting and Exploiting Symmetry in Affine Images,"
Philosophical Transactions: Physical Sciences and Eng., vol. 351, no. 1695, pp. 77-106, http://www.jstor.org/stable54462, 1995.- [29] L. Van Gool, M. Proesmans, and T. Moons, "Mirror and Point Symmetry under Perspective Skewing,"
Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 285-292, 1996.- [30] Y. Sato and S. Tamura, "Detecting Planar and Curved Symmetries of 3D Shapes from a Range Image,"
Computer Vision and Image Understanding, vol. 64, no. 1, pp. 175-187, 1996.- [31] A. Tuzikov, G. Margolin, and A. Grenov, "Convex Set Symmetry Measurement via Minkowski Addition,"
J. Math. Imaging and Vision, vol. 7, no. 1, pp. 53-68, Jan. 1997.- [32] C. Sun and J. Sherrah, "3D Symmetry Detection Using the Extended Gaussian Image,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 2, pp. 164-168, Feb. 1997.- [33] N. Kiryati and Y. Gofman, "Detecting Symmetry in Grey Level Images: The Global Optimization Approach,"
Int'l J. Computer Vision, vol. 29, no. 1, pp. 29-45, 1998.- [34] S. Carlsson, "Symmetry in Perspective,"
Proc. European Conf. Computer Vision, vol. 1, pp. 249-263, 1998.- [35] R. Curwen, J. Mundy, and C. Stewart, "Recognition of Plane Projective Symmetry,"
Proc. Sixth IEEE Int'l Conf. Computer Vision, pp. 1115-1122, 1998.- [36] A.M. Bruckstein and D. Snaked, "Skew Symmetry Detection via Invariant Signatures,"
Pattern Recognition, vol. 31, no. 2, pp. 181-192, 1998.- [37] C. Sun and D. Si, "Fast Reflectional Symmetry Detection Using Orientation Histograms,"
Real-Time Imaging, vol. 5, no. 1, pp. 63-74, 1999.- [38] Y. Lei and K. Wong, "Detection and Localisation of Reflectional and Rotational Symmetry under Weak Perspective Projection,"
Pattern Recognition, vol. 32, no. 2, pp. 167-180, 1999.- [39] D. Shen, H. Ip, and E. Teoh, "Robust Detection of Skewed Symmetries,"
Proc. Int'l Conf. Pattern Recognition, pp. 1010-1013, 2000.- [40] M. Kazhdan, B. Chazelle, D. Dobkin, A. Finkelstein, and T. Funkhouser, "A Reflective Symmetry Descriptor,"
Proc. European Conf. Computer Vision, pp. 642-656, 2002.- [41] V. Prasad and B. Yegnanarayana, "Finding Axes of Symmetry from Potential Fields,"
IEEE Trans. Image Processing, vol. 13, no. 12, pp. 1559-1566, Dec. 2004.- [42] T. Yuan and X. Tang, "Efficient Local Reflectional Symmetries Detection,"
Proc. IEEE Int'l Conf. Image Processing, vol. 3, pp. III-1180-3, Sept. 2005.- [43] G. Marola, "A Technique for Finding the Symmetry Axes of Implicit Polynomial Curves under Perspective Projection,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 3, pp. 465-470, Mar. 2005.- [44] Y.-Q.X. Yanxi Liu, J.H. Hays, and H.-Y. Shum, "Digital Papercutting,"
Proc. Technical Sketch, ACM Siggraph, 2005.- [45] H. Cornelius and G. Loy, "Detecting Bilateral Symmetry in Perspective,"
Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition Workshop, p. 191, 2006.- [46] N.J. Mitra, L.J. Guibas, and M. Pauly, "Partial and Approximate Symmetry Detection for 3D Geometry,"
ACM Trans. Graphics, vol. 25, no. 3, pp. 560-568, 2006.- [47] A. Martinet, C. Soler, N. Holzschuch, and F.X. Sillion, "Accurate Detection of Symmetries in 3D Shapes,"
ACM Trans. Graphics, vol. 25, no. 2, pp. 439-464, 2006.- [48] J. Podolak, P. Shilane, A. Golovinskiy, S. Rusinkiewicz, and T. Funkhouser, "A Planar-Reflective Symmetry Transform for 3D Shapes,"
ACM Trans. Graphics, vol. 25, no. 3, pp. 549-559, July 2006.- [49] N.J. Mitra, L. Guibas, and M. Pauly, "Symmetrization,"
ACM Trans. Graphics, vol. 26, no. 3, pp. 1-8, 2007.- [50] K. Bitsakos, H. Yi, L. Yi, and C. Fermuller, "Bilateral Symmetry of Object Silhouettes under Perspective Projection,"
Proc. Int'l Conf. Pattern Recognition, pp. 1-4, 2008.- [51] M. Pauly, N.J. Mitra, J. Wallner, H. Pottmann, and L. Guibas, "Discovering Structural Regularity in 3D Geometry,"
ACM Trans. Graphics, vol. 27, no. 3, pp. 1-11, 2008.- [52] T. Riklin-Raviv, N. Sochen, and N. Kiryati, "On Symmetry, Perspectivity, and Level-Set-Based Segmentation,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 8, pp. 1458-1471, Aug. 2009.- [53] J. Liu and Y. Liu, "Curved Reflection Symmetry Detection with Self-Validation,"
Proc. 10th Asian Conf. Com1puter Vision, 2010.- [54] A. Ylä-Jääski and F. Ade, "Grouping Symmetrical Structures for Object Segmentation and Description,"
Computer Vision and Image Understanding, vol. 63, pp. 399-417, May 1996.- [55] V. Prasad and L. Davis, "Detecting Rotational Symmetries,"
Proc. IEEE Int'l Conf. Computer Vision, pp. 954-961, 2005.- [56] P.-C. Chen, J.H. Hays, S. Lee, M. Park, and Y. Liu, "A Quantitative Evaluation of Symmetry Detection Algorithms," Technical Report CMU-RI-TR-07-36, Robotics Inst., Carnegie Mellon Univ., Sept. 2007.
- [57] D. Milner, S. Raz, H. Hel-Or, D. Keren, and E. Nevo, "A New Measure of Symmetry and Its Application to Classification of Bifurcating Structures,"
Pattern Recognition, vol. 40, pp. 2237-2250, Aug. 2007.- [58] D.A. Forsyth and J. Ponce,
Computer Vision: A Modern Approach. Prentice Hall, Aug. 2002.- [59] M. Brady and H. Asada, "Smoothed Local Symmetries and Their Implementation," technical report, MIT, 1984.
- [60] K. Siddiqi and E.S. Pizer,
Medial Representations: Mathematics, Algorithms and Applications. Series: Computational Imaging and Vision, vol. 37. Springer, 2008.- [61] A. Levinshtein, S. Dickinson, and C. Sminchisescu, "Multiscale Symmetric Part Detection and Grouping,"
Proc. IEEE Int'l Conf. Computer Vision, Sept. 2009.- [62] R. Guillemaud, P. Marais, A. Zisserman, B. McDonald, T. Crow, and M. Brady, "A Three Dimensional Mid Sagittal Plane for Brain Asymmetry Measurement,"
Schizophr, vol. 18, pp. 183-184, 1996.- [63] Y. Liu and R. Collins, "Automatic Extraction of the Central Symmetry Plane from Neuroradiology Images," Technical Report CMU-RI-TR-96-40, Robotics Inst., Carengie Mellon Univ., Dec. 1996.
- [64] Y. Liu, R. Collins, and W.E. Rothfus, "Evaluation of a Robust Midsagittal Plane Extraction Algorithm for Coarse, Pathological 3D Images,"
Proc. Medical Imaging Computing and Computer Assisted Intervention Conf., Oct. 2000.- [65] B. Ardekani, J. Kershaw, M. Braun, and I. Kanno, "Automatic Detection of the Mid-Sagittal Plane in 3-D Brain Images,"
IEEE Trans. Medical Imaging, vol. 16, no. 6, pp. 947-952, Dec. 1997.- [66] S. Minoshima, K.L. Berger, K.S. Lee, and M.A. Mintum, "An Automated Method for Rotational Correction and Centering of Three-Dimensional Functional Brain Images,"
European J. Nuclear Medicine and Molecular Imaging, vol. 33, pp. 1579-1585, 1992.- [67] S. Prima, S. Ourselin, and N. Ayache, "Computation of the Mid-Sagittal Plane in 3-D Brain Images,"
IEEE Trans. Medical Imaging, vol. 21, no. 2, pp. 122-138, Feb. 2002.- [68] M.B. Stegmanna, K. Skoglunda, and C. Rybergb, "Mid-Sagittal Plane and Mid-Sagittal Surface Optimization in Brain MRI Using a Local Symmetry Measure,"
Medical Imaging, vol. 5747, pp. 568-579, 2005.- [69] D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints,"
Int'l J. Computer Vision, vol. 60, pp. 91-110, 2004.- [70] M.A. Fischler and R.C. Bolles, "Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography,"
Readings in Computer Vision: Issues, Problems, Principles, and Paradigms, pp. 726-740, Morgan Kaufmann, 1987.- [71] O.J.O. Söderkvist, "Computer Vision Classification of Leaves from Swedish Trees," master's thesis, Linköping Univ., SE-581 83, Sweden, liTH-ISY-EX-3132, Sept. 2001.
- [72] G.D. Birkoff and O.D. Kellogg, "Outline for the Study of Scoliosis,"
AAOS Instructional Course Lectures, vol. 5, pp. 261-275, 1948.- [73] J. DErrico, "Surface Fitting Using Gridfit,"
Matlab Central File Exchange, Retrieved, July 2009.- [74]
Zebrafish Atlas, http://zfatlas.psu.eduindex.php, 2011.- [75] S. Lee and Y. Liu, "Skewed Rotation Symmetry Group Detection,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 9, pp. 1659-1672, Sept. 2010. |