This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Integral Invariants for Shape Matching
October 2006 (vol. 28 no. 10)
pp. 1602-1618
For shapes represented as closed planar contours, we introduce a class of functionals which are invariant with respect to the Euclidean group and which are obtained by performing integral operations. While such integral invariants enjoy some of the desirable properties of their differential counterparts, such as locality of computation (which allows matching under occlusions) and uniqueness of representation (asymptotically), they do not exhibit the noise sensitivity associated with differential quantities and, therefore, do not require presmoothing of the input shape. Our formulation allows the analysis of shapes at multiple scales. Based on integral invariants, we define a notion of distance between shapes. The proposed distance measure can be computed efficiently and allows warping the shape boundaries onto each other; its computation results in optimal point correspondence as an intermediate step. Numerical results on shape matching demonstrate that this framework can match shapes despite the deformation of subparts, missing parts and noise. As a quantitative analysis, we report matching scores for shape retrieval from a database.

[1] R. Alferez and Y.F. Wang, “Geometric and Illumination Invariants for Object Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 6, pp. 505-536, June 1999.
[2] K. Arbter, W.E. Snyder, H. Burkhardt, and G. Hirzinger, “Applications of Affine-Invariant Fourier Descriptors to Recognition of 3-D Objects,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 7, pp. 640-646, July 1990.
[3] N. Ayache and O. Faugeras, “HYPER: A New Approach for the Recognition and Positioning of Two-Dimensional Objects,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 1, pp. 44-54, 1986.
[4] M. Bakircioglu, U. Grenander, N. Khaneja, and M.I. Miller, “Curve Matching on Brain Surfaces Using Frenet Distances,” Human Brain Mapping, vol. 6, pp. 329-333, 1998.
[5] R. Basri, L. Costa, D. Geiger, and D. Jacobs, “Determining the Similarity of Deformable Shapes,” Vision Research, vol. 38, pp. 2365-2385, 1998.
[6] S. Belongie, J. Malik, and J. Puzicha, “Shape Matching and Object Recognition Using Shape Contexts,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 509-522, Apr. 2002.
[7] A. Bengtsson and J.-O. Eklundh, “Shape Representation by Multiscale Contour Approximation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 1, pp. 85-93, Jan. 1991.
[8] M. Boutin, “Numerically Invariant Signature Curves,” Int'l J. Computer Vision, vol. 40, no. 3, pp. 235-248, 2000.
[9] R.D. Brandt and F. Lin, “Representations that Uniquely Characterize Images Modulo Translation, Rotation and Scaling,” Pattern Recognition Letters, vol. 17, pp. 1001-1015, 1996.
[10] A. Bruckstein, N. Katzir, M. Lindenbaum, and M. Porat, “Similarity Invariant Signatures for Partially Occluded Planar Shapes,” Int'l J. Computer Vision, vol. 7, no. 3, pp. 271-285, 1992.
[11] A.M. Bruckstein, R.J. Holt, A.N. Netravali, and T.J. Richardson, “Invariant Signatures for Planar Shape Recognition under Partial Occlusion,” J. Computer Vision, Graphics, and Image Processing, vol. 58, no. 1, pp. 49-65, 1993.
[12] A.M. Bruckstein, E. Rivlin, and I. Weiss, “Scale-Space Semi-Local Invariants,” Image and Vision Computing, vol. 15, no. 5, pp. 335-344, 1997.
[13] E. Calabi, P. Olver, C. Shakiban, A. Tannenbaum, and S. Haker, “Differential and Numerically Invariant Signature Curves Applied to Object Recognition,” Int'l J. Computer Vision, vol. 26, pp. 107-135, 1998.
[14] D. Chetverikov and Y. Khenokh, “Matching for Shape Defect Detection,” Lecture Notes in Computer Science, vol. 1689, no. 2, pp. 367-374, 1999.
[15] I. Cohen, N. Ayache, and P. Sulger, “Tracking Points on Deformable Objects Using Curvature Information,” Proc. European Conf. Computer Vision, pp. 458-466, 1992.
[16] T. Cohignac, C. Lopez, and J.M. Morel, “Integral and Local Affine Invariant Parameter and Application to Shape Recognition,” Proc. Int'l Conf. Pattern Recognition, vol. 1, pp. 164-168, 1994.
[17] J.B. Cole, H. Murase, and S. Naito, “A Lie Group Theoretical Approach to the Invariance Problem in Feature Extraction and Object Recognition,” Pattern Recognition Letters, vol. 12, pp. 519-523, 1991.
[18] D. Cremers, T. Kohlberger, and C. Schnörr, “Shape Statistics in Kernel Space for Variational Image Segmentation,” Pattern Recognition, vol. 36, no. 9, pp. 1929-1943, 2003.
[19] D. Cremers, S.J. Osher, and S. Soatto, “Kernel Density Estimation and Intrinsic Alignment for Knowledge-Driven Segmentation: Teaching Level Sets to Walk,” Pattern Recognition, Sept. 2004.
[20] D. Cremers and S. Soatto, “A Pseudo-Distance for Shape Priors in Level Set Segmentation,” Proc. IEEE Second Int'l Workshop Variational, Geometric, and Level Set Methods, pp. 169-176, 2003.
[21] R. Davies, C. Twining, T. Cootes, J Waterton, and C Taylor, “A Minimum Description Length Approach to Statistical Shape Modeling,” IEEE Trans. Medical Imaging, vol. 21, no. 5, pp. 525-537, 2002.
[22] A. DelBimbo and P. Pala, “Visual Image Retrieval by Elastic Matching of User Sketches,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 2, pp. 121-132, Feb. 1997.
[23] A. Dervieux and F. Thomasset, “A Finite Element Method for the Simulation of Raleigh-Taylor Instability,” Springer Lecture Notes in Math., vol. 771, pp. 145-158, 1979.
[24] L.E. Dickson, Algebraic Invariants. John Wiley and Sons, 1914.
[25] J. Dieudonne and J. Carrell, Invariant Theory: Old and New. Academic Press, 1970.
[26] I.L. Dryden and K.V. Mardia, Statistical Shape Analysis. Wiley, 1998.
[27] J. Flusser and T. Suk, “Pattern Recognition by Affine Moment Invariants,” Pattern Recognition, vol. 26, no. 1, pp. 167-174, 1993.
[28] D.A. Forsyth, J.L. Mundy, A. Zisserman, and C.M. Brown, “Projectively Invariant Representations Using Implicit Algebraic Curves,” Image and Vision Computing, vol. 9, no. 2, pp. 130-136, 1991.
[29] D.A. Forsyth, J.L. Mundy, A.P. Zisserman, C. Coelho, A. Heller, and C.A. Othwell, “Invariant Descriptors for 3-D Object Recognition and Pose,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 10, pp. 971-991, Oct. 1991.
[30] Y. Gdalyahu and D. Weinshall, “Flexible Syntactic Matching of Curves and Its Application to Automatic Hierarchical Classication of Silhouettes,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 12, pp. 1312-1328, Dec. 1999.
[31] L. Van Gool, T. Moons, E. Pauwels, and A. Oosterlinck, “Semi-Differential Invariants,” Geometric Invariance in Computer Vision, pp. 193-214, 1992.
[32] L. Van Gool, T. Moons, and D. Ungureanu, “Affine/Photometric Invariants for Planar Intensity Patterns,” Proc. European Conf. Computer Vision, vol. 1, pp. 642-651, 1996.
[33] J.H. Grace and A. Young, The Algebra of Invariants. Cambridge Univ. Press, 1903.
[34] C.E. Hann and M.S. Hickman, “Projective Curvature and Integral Invariants,” Int'l J. Computer Vision, vol. 40, no. 3, pp. 235-248, 2000.
[35] M.K. Hu, “Visual Pattern Recognition by Moment Invariants,” IRE Trans. IT, vol. 8, pp. 179-187, 1961.
[36] K. Kanatani, Group Theoretical Methods in Image Understanding. Springer, 1990.
[37] E. Klassen, A. Srivastava, M. Mio, and S.H. Joshi, “Analysis of Planar Shapes Using Geodesic Paths on Shape Spaces,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 3, pp. 372-383, Mar. 2004.
[38] P.N. Klein, S. Tirthapura, D. Sharvit, and B. Kimia, “A Tree-Edit-Distance Algorithm for Comparing Simple, Closed Shapes,” Proc. Symp. Discrete Algorithms, pp. 696-704, 2000.
[39] E.P. Lane, Projective Differential Geometry of Curves and Surfaces. Univ. of Chicago Press, 1932.
[40] J. Lasenby, E. Bayro-Corrochano, A.N. Lasenby, and G. Sommer, “A New Framework for the Formation of Invariants and Multiple-View Constraints in Computer Vision,” Proc. Int'l Conf. Image Processing, pp. 313-316, 1996.
[41] L.J. Latecki and R. Lakämper, “Shape Similarity Measure Based on Correspondence of Visual Parts,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 10, pp. 1185-1190, Oct. 2000.
[42] H. Le and D.G. Kendall, “The Riemannian Structure of Euclidean Shape Spaces: A Novel Environment for Statistics,” Annals of Statistics, vol. 21, no. 3, pp. 1225-1271, 1993.
[43] G. Lei, “Recognition of Planar Objects in 3-D Space from Single Perspective Views Using Cross Ratio,” Robotics and Automation, vol. 6, no. 4, pp. 432-437, 1990.
[44] R. Lenz, “Group Theoretical Methods in Image Processing,” Lecture Notes in Computer Science, vol. 413, 1990.
[45] M.E. Leventon, W.E.L. Grimson, and O. Faugeras, “Statistical Shape Influence in Geodesic Active Contours,” Proc. Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 316-323, June 2000.
[46] S.Z. Li, “Shape Matching Based on Invariants,” Progress in Neural Networks: Shape Recognition, vol. 6, pp. 203-228, 1999.
[47] S. Liao and M. Pawlak, “On Image Analysis by Moments,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 3, pp. 254-266, Mar. 1996.
[48] H. Liu and M. Srinath, “Partial Shape Classification Using Contour Matching in Distance Transforms,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 2, pp. 1072-1079, Feb. 1990.
[49] T. Liu and D. Geiger, “Approximate Tree Matching and Shape Similarity,” Proc. Int'l Conf. Computer Vision, pp. 456-462, 1999.
[50] S. Manay, B. Hong, A. Yezzi, and S. Soatto, “Integral Invariant Signatures,” Proc. European Conf. Computer Vision, May 2004.
[51] J.S. Marques and A.J. Abrantes, “Shape Alignment— Optimal Initial Point and Pose Estimation,” Pattern Recognition Letters, vol. 18, no. 1, pp. 49-53, 1997.
[52] T. Miyatake, T. Matsuyama, and M. Nagao, “Affine Transform Invariant Curve Recognition Using Fourier Descriptors,” Information Processing Soc. Japan, vol. 24, no. 1, pp. 64-71, 1983.
[53] F. Mokhtarian and A.K. Mackworth, “Scale-Based Description and Recognition of Planar Curves and Two-Dimensional Shapes,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 1, pp. 34-43, Jan. 1986.
[54] F. Mokhtarian and A.K. Mackworth, “A Theory of MultiScale, Curvature-Based Shape Representation for Planar Curves,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 8, pp. 789-805, Aug. 1992.
[55] D. Mumford, “Mathematical Theories of Shape: Do They Model Perception,” Geometric Methods in Computer Vision, vol. 1570, pp. 2-10, 1991.
[56] D. Mumford, J. Fogarty, and F.C. Kirwan, Geometric Invariant Theory, third ed. Springer-Verlag, 1994.
[57] D. Mumford, A. Latto, and J. Shah, “The Representation of Shape,” Proc. IEEE Workshop Computer Vision, pp. 183-191, 1984.
[58] Geometric Invariance in Computer Vision. J.L. Mundy and A. Zisserman, eds. MIT Press, 1992.
[59] L. Nielsen and G. Saprr, “Projective Area-Invariants as an Extension of the Cross-Ratio,” J. Computer Vision, Graphics, and Image Processing, vol. 54, no. 1, pp. 145-159, 1991.
[60] P.J. Olver, Equivalence, Invariants and Symmetry. Cambridge, 1995.
[61] S.J. Osher and J.A. Sethian, “Fronts Propagation with Curvature Dependent Speed: Algorithms Based on Hamilton-Jacobi Formulations,” J. Computer Physics, vol. 79, pp. 12-49, 1988.
[62] T. Pajdla and L. Van Gool, “Matching of 3-D Curves Using Semi-Differential Invariants,” Proc. Int'l Conf. Computer Vision, pp. 390-395, 1995.
[63] M. Pelillo, K. Siddiqi, and S.W. Zucker, “Matching Hierarchical Structures Using Association Graphs,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 11, pp. 1105-1120, Nov. 1999.
[64] A. Pikaz and I. Dinstein, “Matching of Partially Occluded Planar Curves,” Pattern Recognition, vol. 28, no. 2, pp. 199-209, 1995.
[65] A. Pitiot, H. Delingette, A. Toga, and P. Thompson, “Learning Object Correspondences with the Observed Transport Shape Measure,” Proc. Conf. Information Processing in Medical Imaging, 2003.
[66] T.H. Reiss, “Recognizing Planar Objects Using Invariant Image Features,” Lecture Notes in Computer Science, vol. 676, 1993.
[67] C. Rothwell, A. Zisserman, D. Forsyth, and J. Mundy, “Canonical Frames for Planar Object Recognition,” Proc. European Conf. Computer Vision, pp. 757-772, 1992.
[68] C. Rothwell, A. Zisserman, D. Forsyth, and J. Mundy, “Planar Object Recognition Using Projective Shape Representation,” Int'l J. Computer Vision, vol. 16, pp. 57-99, 1995.
[69] M. Rousson and N. Paragios, “Shape Priors for Level Set Representations,” Proc. European Conf. Computer Vision, May 2002.
[70] H. Sakoe and S. Chiba, “Dynamic Programming Algorithm Optimization for Spoken Word Recognition,” IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 26, no. 1, pp. 43-49, 1978.
[71] G. Sapiro and A. Tannenbaum, “Affine Invariant Scale Space,” Int'l J. Computer Vision, vol. 11, no. 1, pp. 25-44, 1993.
[72] G. Sapiro and A. Tannenbaum, “Area and Length Preserving Geometric Invariant Scale-Spaces,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 1, pp. 67-72, Jan. 1995.
[73] J. Sato and R. Cipolla, “Affine Integral Invariants for Extracting Symmetry Axes,” Image and Vision Computing, vol. 15, no. 8, pp. 627-635, 1997.
[74] H. Schulz-Mirbach, “Invariant Features for Gray Scale Images,” Proc. 17th Ann. Symp. German Assoc. for Pattern Recognition, pp. 1-14, 1995.
[75] J. Schwartz and M. Sharir, “Identification of Partially Obscured Objects in Two and Three Dimensions by Matching Noisy Characteristic Curves,” Int'l J. Robotic Research, vol. 6, no. 2, pp. 29-44, 1987.
[76] T. Sebastian, P. Klein, and B. Kimia, “On Aligning Curves,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 1, pp. 116-125. Jan. 2003.
[77] E. Sharon and D. Mumford, “2D-Shape Analysis Using Conformal Mapping,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2004.
[78] D. Sharvit, J. Chan, H. Tek, and B. Kimia, “Symmetry-Based Indexing of Image Databases,” Proc. IEEE Workshop Content-Based Access of Image and Video Libraries, pp. 56-62, 1998.
[79] A. Shashua and N. Navab, “Relative Affine Structure: Canonical Model for 3D From 2D Geometry and Applications,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 9, pp. 873-883, Sept. 1996.
[80] K. Siddiqi, A. Shokoufandeh, S.J. Dickinson, and S.W. Zucker, “Shock Graphs and Shape Matching,” Proc. Int'l Conf. Computer Vision, pp. 222-229, 1998.
[81] C.E. Springer, Geometry and Analysis of Projective Spaces. San Francisco: Freeman, 1964.
[82] H. Tagare, D. O'Shea, and A. Rangarajan, “A Geometric Correspondence for Shape-Based NonRigid Correspondence,” Proc. Int'l Conf. Computer Vision, pp. 434-439, 1995.
[83] Q.M. Tieng and W.W. Boles, “Recognition of 2D Object Contours Using the Wavelet Transform Zero-Crossing Representation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 8, pp. 910-916, Aug. 1997.
[84] C. Tomasi and R. Manduchi, “Stereo without Search,” Proc. European Conf. Computer Vision, pp. 452-465, 1996.
[85] A. Trouve and L. Younes, “Diffeomorphic Matching Problems in One Dimension: Designing and Minimizing Matching Functions,” Proc. European Conf. Computer Vision, pp. 573-587, 2000.
[86] A. Tsai, A. Yezzi, W. Wells, C. Tempany, D. Tucker, A. Fan, E. Grimson, and A. Willsky, “Model-Based Curve Evolution Technique for Image Segmentation,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 463-468, 2001.
[87] S. Umeyama, “Parameterized Point Pattern Matching and Its Application to Recognition of Object Families,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 2, pp. 136-144, Feb. 1993.
[88] J. Verestoy and D. Chetverikov, “Shape Detection in Ferrite Cores,” Machine Graphics and Vision, vol. 6, no. 2, pp. 225-236, 1997.
[89] I. Weiss, “Noise Resistant Invariants of Curves,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 9, pp. 943-948, Sept. 1993.
[90] A.P. Witkin, “Scale-Space Filtering,” Proc. Int'l Joint Conf. Artificial Intelligence, pp. 1019-1021, 1983.
[91] H. Wolfson, “On Curve Matching,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 5, pp. 483-489, May 1990.
[92] L. Younes, “Optimal Matching between Shapes via Elastic Deformations,” Image and Vision Computing, vol. 17, pp. 381-389, 1999.
[93] C.T. Zahn and R.Z. Roskies, “Fourier Descriptors for Plane Closed Curves,” IEEE Trans. Computers, vol. 21, pp. 269-281, 1972.
[94] S. Zhu and A. Yuille, “Forms: A Flexible Object Recognition and Modeling System,” Int'l J. Computer Vision, vol. 20, no. 3, pp. 187-212, 1996.
[95] A. Zisserman, D.A. Forsyth, J.L. Mundy, C.A. Rothwell, and J.S. Liu, “3D Object Recognition Using Invariance,” Artificial Intelligence, vol. 78, pp. 239-288, 1995.

Index Terms:
Integral invariants, shape, shape matching, shape distance, shape retrieval.
Citation:
Siddharth Manay, Daniel Cremers, Byung-Woo Hong, Anthony J. Yezzi, Stefano Soatto, "Integral Invariants for Shape Matching," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 10, pp. 1602-1618, Oct. 2006, doi:10.1109/TPAMI.2006.208
Usage of this product signifies your acceptance of the Terms of Use.