This Article 
 Bibliographic References 
 Add to: 
Recognition by Symmetry Derivatives and the Generalized Structure Tensor
December 2004 (vol. 26 no. 12)
pp. 1590-1605
We suggest a set of complex differential operators that can be used to produce and filter dense orientation (tensor) fields for feature extraction, matching, and pattern recognition. We present results on the invariance properties of these operators, that we call symmetry derivatives. These show that, in contrast to ordinary derivatives, all orders of symmetry derivatives of Gaussians yield a remarkable invariance: They are obtained by replacing the original differential polynomial with the same polynomial, but using ordinary coordinates x and y corresponding to partial derivatives. Moreover, the symmetry derivatives of Gaussians are closed under the convolution operator and they are invariant to the Fourier transform. The equivalent of the structure tensor, representing and extracting orientations of curve patterns, had previously been shown to hold in harmonic coordinates in a nearly identical manner. As a result, positions, orientations, and certainties of intricate patterns, e.g., spirals, crosses, parabolic shapes, can be modeled by use of symmetry derivatives of Gaussians with greater analytical precision as well as computational efficiency. Since Gaussians and their derivatives are utilized extensively in image processing, the revealed properties have practical consequences for local orientation based feature extraction. The usefulness of these results is demonstrated by two applications: 1) tracking cross markers in long image sequences from vehicle crash tests and 2) alignment of noisy fingerprints.

[1] Y.S. Abu-Mostafa and D. Psaltis, “Recognitive Aspects of Moment Invariants,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, pp. 698-706, 1984.
[2] A.M. Bazen and S.H. Gerez, “Systematic Methods for the Computation of the Directional Fields and Singular Points of Fingerprints,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 905-919, July 2002.
[3] J. Bigun, “Recognition of Local Symmetries in Gray Value Images by Harmonic Functions,” Proc. Ninth Int'l Conf. Pattern Recognition, pp. 345-347, Nov. 1988.
[4] J. Bigun and T. Bigun, “Symmetry Derivatives of Gaussians Illustrated by Cross Tracking,” Technical Report HH-IDE-131, Halmstad Univ., SE-30118 Halmstad, 2001.
[5] J. Bigun and J.M.H. du Buf, “N-Folded Symmetries by Complex Moments in Gabor Space,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 1, pp. 80-87, Jan. 1994.
[6] J. Bigun and G.H. Granlund, “Optimal Orientation Detection of Linear Symmetry,” Proc. First Int'l Conf. Computer Vision, pp. 433-438, June 1987.
[7] M.J. Black and P. Anandan, “A Framework for the Robust Estimation of Optical Flow,” Proc. Int'l Conf. Computer Vision, pp. 231-236, 1993.
[8] H. Burkhardt, “Transformationen Zur Lageinvarianten Merkmalgewinnung,” PhD thesis, Habilitationsschrift, Univ. Karlsruhe, Ersch. als Fortschrittbericht, vol. 10, no. 7, der VDI-Zeitschriften, VDI-Verlag, 1979.
[9] P. Burt, “Fast Filter Transforms for Image Processing,” Computer Graphics and Image Processing, vol. 16, pp. 20-51, 1981.
[10] P.E. Danielsson, Q. Lin, and Q.Z. Ye, “Efficient Detection of Second-Degree Variations in 2D and 3D Images,” Visual Comm. and Image Representation, vol. 12, pp. 255-305, 2001.
[11] P.E. Danielsson, “Rotation Invariant Linear Operators with Directional Response,” Proc. Fifth Int'l Conf. Pattern Recognition, pp. 1171-1176, Dec. 1980.
[12] D.E. Dudgeon and R.M. Mersereau, Multi Dimensional Digital Signal Processing, Englewood Cliffs, N.J.: Prentice Hall, 1981.
[13] M. Ferraro and T.M. Caelli, “Relationship Between Integral Transform Invariances and Lie Group Theory,” J. Optical Soc. Am. A, vol. 5, no. 5, pp. 738-742, 1988.
[14] W. Forstner and E. Gulch, “A Fast Operator for Detection and Precise Location of Distinct Points, Corners and Centres of Circular Features,” Proc. Intercommission Conf. Fast Processing of Photogrammetric Data, pp. 281-305, 1987.
[15] W.T. Freeman and E.H. Adelson, “The Design and Use of Steerable Filters,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 9, pp. 891-906, Sept. 1991.
[16] G.H. Granlund, “Fourier Preprocessing for Hand Print Character Recognition,” IEEE Trans. Computers, vol. 21, pp. 195-201, 1972.
[17] C. Harris and M. Stephens, “A Combined Corner and Edge Detector,” Proc. Fourth Alvey Vision Conf., pp. 147-151, Aug. 1988.
[18] W.C. Hoffman, “The Lie Algebra of Visual Perception,” J. Math. Psychol., vol. 3, pp. 65-98, 1966.
[19] L. Hong, Y. Wand, and A.K. Jain, “Fingerprint Image Enhancement: Algorithm and Performance Evaluation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 8, pp. 777-789, Aug. 1998.
[20] M.K. Hu, “Visual Pattern Recognition by Moment Invariants,” IRE Trans. Information Theory, pp. 179-187, 1962.
[21] A.K. Jain, L. Hong, S. Pankanti, and R. Bolle, “An Identity Authentication System Using Fingerprints,” Proc. IEEE, vol. 85, no. 9, pp. 1365-1388, 1997.
[22] B. Johansson, “Multiscale Curvature Detection in Computer Vision,” Lic. thesis no. 877; LIU-TEK-LIC-2001:14, Linkoping Univ., Dept. EE (ISY), SE-581 83, Linkoping, 2001.
[23] M. Kass and A. Witkin, “Analyzing Oriented Patterns,” Computer Vision, Graphics, and Image Processing, vol. 37, pp. 362-385, 1987.
[24] H. Knutsson, “Representing Local Structure Using Tensors,” Proc. Sixth Scandinavian Conf. Image Analysis, pp. 244-251, June 1989.
[25] H. Knutsson, M. Hedlund, and G.H. Granlund, “Apparatus for Determining the Degree of Consistency of a Feature in a Region of an Image that is Divided into Discrete Picture Elements,” US patent, 4.747.152, 1988.
[26] J.J. Koenderink and A.J. van Doorn, “The Structure of Images,” Biological Cybernetics, vol. 50, pp. 363-370, 1984.
[27] J.J. Koenderink and A.J. van Doorn, “Receptive Field Families,” Biological Cybernetics, vol. 63, pp. 291-298, 1990.
[28] T. Lindeberg, “Discrete Scale-Space Theory and the Scale Space Primal Sketch,” PhD thesis, Royal Inst. of Technology, NADA-CVAP S-100 44, Stockholm, 1991.
[29] B.D. Lucas and T. Kanade, “An Iterative Image Registration Technique with an Application to Stereo Vision,” Proc. Seventh Int'l Joint Conf. Artificial Intelligence, pp. 674-679, 1981.
[30] D. Maio, D. Maltoni, R. Cappelli, J.L. Wayman, and A.K. Jain, “FVC 2000: Fingerprint Verification Competition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 3, pp. 402-412, Mar. 2002.
[31] K.V. Mardia, Statistics of Directional Data. Academic Press, 1972.
[32] D. Marr and E. Hildreth, “Theory of Edge Detection,” Proc. Royal Soc. London Bull., vol. 204, pp. 301-328, 1979.
[33] G. Medioni, M.S. Lee, and C.K. Tang, A Computational Framework for Segmentation and Grouping. Elsevier, 2000.
[34] P. Perona, “Steerable–Scalable Kernels for Edge Detection and Junction Analysis,” Proc. European Conf. Computer Vision, pp. 3-18, 1992.
[35] A.R. Rao, A Taxonomy for Texture Description and Identification. Springer, 1990.
[36] S.S. Reddi, “Radial and Angular Invariants for Image Identification,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 3, no. 2, pp. 240-242, 1981.
[37] E.P. Simoncelli, “A Rotation Invariant Pattern Signature,” Proc. Int'l Conf. Image Processing, vol. 3, pp. 185-188, 1996.
[38] D. Slepian, “Prolate Spheroidal Wave Functions, Fourier Analysis and Uncertainty-IV: Extensions to Many Dimensions; Generalized Prolate Spheroidal Functions,” The Bell System Technical J., vol. 43, pp. 3009-3057, Nov. 1964.
[39] E. Stein and G. Weiss, Fourier Analysis on Euclidean Spaces. Princeton, N.J.: Princeton Univ. Press, 1971.
[40] M. Unser, A. Aldroubi, and M. Eden, “Fast B-Spline Transforms for Continuous Image Representation and Interpolation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 3, pp. 277-285, Mar. 1991.
[41] R. Wilson and M. Spann, “Finite Prolate Spheroidal Sequences and their Applications II: Image Feature Description and Segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, pp. 193-203, Oct. 1988.
[42] A.P. Witkin, “Scale-Space Filtering,” Proc. Eighth Int'l Joint Conf. Artificial Intelligence, pp. 1019-1022, Aug. 1983.

Index Terms:
Gaussians, orientation fields, structure tensor, differential invariants, cross detection, fingerprints, tensor voting, tracking, filtering, feature measurement, wavelets and fractals, moments, invariants, vision and scene understanding, representations, shape, tracking, registration, alignment.
Josef Bigun, Tomas Bigun, Kenneth Nilsson, "Recognition by Symmetry Derivatives and the Generalized Structure Tensor," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 12, pp. 1590-1605, Dec. 2004, doi:10.1109/TPAMI.2004.126
Usage of this product signifies your acceptance of the Terms of Use.