This Article 
 Bibliographic References 
 Add to: 
Multidimensional Orientation Estimation with Applications to Texture Analysis and Optical Flow
August 1991 (vol. 13 no. 8)
pp. 775-790

The problem of detection of orientation in finite dimensional Euclidean spaces is solved in the least squares sense. The theory is developed for the case when such orientation computations are necessary at all local neighborhoods of the n-dimensional Euclidean space. Detection of orientation is shown to correspond to fitting an axis or a plane to the Fourier transform of an n-dimensional structure. The solution of this problem is related to the solution of a well-known matrix eigenvalue problem. The computations can be performed in the spatial domain without actually doing a Fourier transformation. Along with the orientation estimate, a certainty measure, based on the error of the fit, is proposed. Two applications in image analysis are considered: texture segmentation and optical flow. The theory is verified by experiments which confirm accurate orientation estimates and reliable certainty measures in the presence of noise. The comparative results indicate that the theory produces algorithms computing robust texture features as well as optical flow.

[1] E. H. Adelson and J. R. Bergen, "Spatiotemporal energy models for the perception of motion,"J. Opt. Soc. Amer. A, vol. 1, no. 2, pp. 284-299, 1985.
[2] E. H. Adelson and J. R. Bergen, "Phenomenal coherence of moving gratings,"Nature, vol. 200, pp. 523-525, 1982.
[3] P. Anandan, "Computing dense displacement fields with confidence measures in scenes containing occlusion," inSPIE Intell. Robots Comput. Vision, vol. 521, 1984.
[4] O. Axelsson and V. A. Barker,Finite Element Solution of Boundary Value Problems: Theory and Computation. Orlando, FL: Academic, 1984.
[5] R. Bajcsy and L. I. Lieberman, "Texture gradient as a depth cue,"Comput. Graphics Image Processing, vol. 5, pp. 52-67, 1976.
[6] J. Bigün and C. Horne, "Feature space dimensionality reduction by using local representability," inProc. Int. Conf. Signal Processing(Beijing, China), Oct. 22-26 1990, pp. 555-558.
[7] J. Bigün and G. H. Granlund, "Optimal orientation detection of linear symmetry," inProc. First Int. Conf. Comput. Vision(London, England), June 1987, pp. 433-443.
[8] J. Bigün, "Recognition of local symmetries in gray value images by harmonic functions," inProc. IAPR 9th Int. Conf. Patt. Recognition(Rome, Italy), Nov. 1988, pp. 345-347.
[9] J. Bigün, "A structure feature for image processing applications based on spiral functions,"Comput. Vision Graphics Image Processing, vol. 51, pp. 166-194, 1990.
[10] C. Blakemore and F. W. Campbell, "On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images,"J. Physiol., vol. 203, pp. 237-260, 1969.
[11] P. Brodatz,Textures. New York: Dover, 1966.
[12] P. Burt, "Fast filter transforms for image processing,"Comput. Graphics Image Processing, vol. 16, pp. 20-51, 1981.
[13] P. Burt, "Smart sensing within a pyramid vision machine,"Proc. IEEE, vol. 76, no. 8, pp. 1006-1015, 1988.
[14] F. W. C. Campbell and J. Robson, "Application of Fourier analysis to the visibility of gratings,"J. Physiol., vol. 197, pp. 551-566, 1968.
[15] R. Courant and D. Hilbert,Methods of Mathematical Physics. New York: Interscience, 1953.
[16] J. L. Crowley and R. M. Stern, "Fast computation of the difference of low-pass transform,"IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-6, pp. 212-222, 1984.
[17] P. E. Danielsson, "Rotation invariant linear operators with directional response," inProc. 5th Int. Conf. Pattern Recognition, Dec. 1980.
[18] J. Daugman, "Six formal properties of two-dimensional anisotropic visual filters: Structural principles and frequency / orientation selectivity,"IEEE Trans. Syst. Man Cybern., vol. SMC-13, pp. 882-887, 1983.
[19] D. E. Dudgeon and R. M. Mersereau,Multidimensional Digital Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, 1981.
[20] O. D. Faugeras, N. Ayache, and Z. Zhang, "A preliminary investigation of the problem of determining ego and object motions from stereo," inProc. 9th ICPR(Rome, Italy), 1988, pp. 242-246.
[21] D. J. Fleet and A. D. Jepson, "Hierarchical construction of orientation and velocity selective filters,"IEEE Trans. Patt. Anal. Machine Intell., vol. 11, no. 3, pp. 315-325, 1989.
[22] D. Gabor, "Theory of communication,"J. Inst. Elec. Eng., vol. 93, pp. 429-459, 1946.
[23] S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restauration of images,"IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-6, no. 6, pp. 721-741, Nov. 1984.
[24] L. J. Goldstein,Abstract Algebra. Englewood Cliffs, NJ: Prentice-Hall, 1973.
[25] G. H. Granlund, "In search of a general picture processing operator,"Comput. Graphics Image Processing, vol. 8, pp. 155-173, 1978.
[26] A. Grossman and J. Morlet, "Decomposition of Hardy functions into square integrable wavelets of constant shape,"SIAM J. Math., vol. 15, pp. 723-736, 1984.
[27] O. Hansen and J. Bigün, "Detection of local symmetries in multi-dimensional images,"inProc. 5th Int. Conf. Image Anal. Processing(Positano, Italy), Sept. 20-22, 1989.
[28] R. M. Haralick and I. Dinstein, "Textural features for image classification,"IEEE Trans. Syst. Man Cybern., vol. SMC-3, pp. 610-621, Nov. 1973.
[29] D. J. Heeger, "Optical flow from spatiotemporal filters," inProc. First Int. Conf. Comput. Vision(London, England), June 1987, pp. 181-190.
[30] B. K. P. Horn and B. G. Schunck, "Determining optical flow,"Artificial Intell., vol. 17, pp. 185-203, 1981.
[31] M. K. Hu, "Visual pattern recognition by moment invariants,"IRE Trans. Inform. Theory, pp. 179-187, 1962.
[32] D. H. Hubel and T. N. Wiesel, " Receptive fields of single neurones in the cat's striate cortex,"J. Physiol., vol. 148, pp. 574-591, 1959.
[33] D. H. Hubel and T. N. Wiesel, "Brain mechanisms of vision,"Sci. Amer., vol. 241, no. 3, pp. 150-162, Sept. 1979.
[34] R. A. Hummel, "Feature detection using basis functions,"Comput. Graphics Image Processing, vol. 9, 1979.
[35] B. Jähne, "Motion determination in space-time images," inSPIE Image Processing III, vol. 1135, pp. 147-152, 1989.
[36] H. Knutsson,Filtering and reconstruction in image processing, Linköping Studies in Science and Technology Dissertation 88, 1982.
[37] K. I. Laws, "Textured image segmentation," Ph. D. dissertation, Dept. Elec. Eng., Univ. Southern California, Los Angeles, 1980.
[38] S. Marcelja, "Mathematical description of the responses of simple cortical cells,"J. Opt. Soc. Amer., vol. 70, pp. 1297-1300, 1980.
[39] D. Marr,Vision. San Francisco, CA: Freeman, 1982.
[40] I. L. Meriam,Statics. New York: Wiley, 1980.
[41] J. A. Movshon, I. D. Thompson, and D. J. Tolhurst, "Spatial and temporal contrast sensitivity of neurons in areas 17 and 18 of the cat's visual cortex,"J. Physiol., vol. 283, pp. 101-120, 1978.
[42] H. H. Nagel, "Image sequences-- Ten (octal) years--From phenomenology toward a theoretical foundation," inProc. Int Conf. Patt. Recognition (IAPR)(Paris, France), Oct. 27-31, 1986, pp. 1174-1185.
[43] Y.C. Lee et al., "Internal Thermal Resistance of a Multi-Chip Packaging Design for VLSI Based Systems,"IEEE Trans. Components, Hybrids, and Manufacturing Technology, Vol. 12, No. 2, June 1989, pp. 163- 169.
[44] A. Papoulis,Signal Analysis. New York: McGraw-Hill, 1977.
[45] M. Porat and Y. Y. Zeevi, "Localized texture processing in vision: Analysis and synthesis in the Gaborian space,"IEEE Trans. Biomed. Eng., vol. 36, pp. 115-129, 1989.
[46] W. Reichardt, "Autocorrelation, a principle for the evaluation of sensory information by the central nervous system," inSensory Communication, W. A. Rosenblith, Ed. Cambridge, MA: MIT Press, 1961, pp. 303-317.
[47] B. Sakitt and H. B. Barlow, "A model for the economical encoding of the visual image in cerebral cortex,"Biol. Cybern., vol. 43, pp. 97-108, 1982.
[48] I.K. Sethi and R. Jain, "Finding trajectories of feature points in a monocular image sequence,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-9, pp. 56-73, Jan. 1987.
[49] M. Spann and R. Wilson, "A quad-tree approach to image segmentation which combines statistical and spatial information,"Patt. Recognition, vol. 18, no. 3/4, pp. 257-269, 1989.
[50] R. Szelski, "Fast surface interpolation using hierarchical basis functions,"IEEE Trans. Patt. Anal. Machine Intell., vol. 6, pp. 513-528, 1990.
[51] S. Tanimoto and T. Pavlidis, "A hierarchical data structure for picture processing,"Comput. Graphics Image Processing, vol. 4, pp. 104-119, 1975.
[52] D. H. Tolhurst and J. A. Bergen, "Spatial and temporal contrast sensitivity of striate cortical neurons,"Nature, vol. 257, pp. 674-675, 1975.
[53] S. Ullman,The Interpretation of Visual Motion. Cambridge, MA: MIT Press, 1979.
[54] M. Unser, "Local linear transforms for texture measurements,"Signal Processing, vol. 11, pp. 61-79, 1986.
[55] M. Unser and M. Eden, "Multiresolution feature extraction and selection for texture feature segmentation,"IEEE Trans. Patt. Anal. Machine Intell., vol. 11, pp. 717-727, July 1989.
[56] A. B. Watson and A. J. Ahumada, Jr., "Model of human visual-motion sensing,"J. Opt. Soc. Amer. A, vol. 1, no. 2, pp. 322-342, 1985.
[57] A. B. Watson, "Detection and recognition of simple spatial forms," inPhysical and Biological Processing of Images, A.C. Slade, Ed. Berlin: Springer-Verlag, 1983.
[58] J. Weng, T.S. Huang, and N. Ahuja, "3-D motion estimation, understanding, and prediction from noisy image sequences,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-9, no. 3, 1987.
[59] E. Wigner, "On the quantum correction for thermodynamic equilibrium,Phys. Rev., vol. 40, pp. 749-759, 1932.
[60] A. Wouk,A Course of Applied Functional Analysis. New York: Wiley, 1979.

Index Terms:
computer vision; multidimensional orientation estimation; least squares approximations; texture analysis; optical flow; finite dimensional Euclidean spaces; Fourier transform; spatial domain; orientation estimate; certainty measure; image analysis; texture segmentation; computer vision; Fourier transforms; least squares approximations
J. Bigün, G.H. Granlund, J. Wiklund, "Multidimensional Orientation Estimation with Applications to Texture Analysis and Optical Flow," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 13, no. 8, pp. 775-790, Aug. 1991, doi:10.1109/34.85668
Usage of this product signifies your acceptance of the Terms of Use.