This Article 
 Bibliographic References 
 Add to: 
Image Representation Using 2D Gabor Wavelets
October 1996 (vol. 18 no. 10)
pp. 959-971

Abstract—This paper extends to two dimensions the frame criterion developed by Daubechies for one-dimensional wavelets, and it computes the frame bounds for the particular case of 2D Gabor wavelets. Completeness criteria for 2D Gabor image representations are important because of their increasing role in many computer vision applications and also in modeling biological vision, since recent neurophysiological evidence from the visual cortex of mammalian brains suggests that the filter response profiles of the main class of linearly-responding cortical neurons (called simple cells) are best modeled as a family of self-similar 2D Gabor wavelets. We therefore derive the conditions under which a set of continuous 2D Gabor wavelets will provide a complete representation of any image, and we also find self-similar wavelet parameterizations which allow stable reconstruction by summation as though the wavelets formed an orthonormal basis. Approximating a "tight frame" generates redundancy which allows low-resolution neural responses to represent high-resolution images, as we illustrate by image reconstructions with severely quantized 2D Gabor coefficients.

[1] Z. Li and J.J. Atick, "Towards a Theory of the Striate Cortex," Neural Computation, vol. 6, pp. 127-146, 1994.
[2] V. Bargmann, P. Butera, L. Girardello, and J.R. Klauder, "On the Completeness of Coherent States," Rep. Math. Phys., vol. 2, pp. 221-228, 1989.
[3] A.C. Bovik,M. Clark,, and W.S. Geisler,“Multichannel texture analysis using localized spatial filters,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, pp. 55-73, 1990.
[4] F.W. Campbell and J.G. Robson, "Application of Fourier Analysis to the Visibility of Gratings," J. Physiology, vol. 197, pp. 551-566, 1968.
[5] I. Daubechies,“The wavelet transform, time-frequency localization, and signal analysis,” IEEE Trans. Information Theory, vol. 36, pp. 961-1,005, 1990.
[6] J.G. Daugman, "Two-Dimensional Spectral Analysis of Cortical Receptive Field Profile," Vision Research, vol. 20, pp. 847-856, 1980.
[7] J.G. Daugman, "Uncertainty Relation for Resolution in Space, Spatial Frequency, and Orientation Optimized by Two-Dimensional Visual Cortical Filters," J. Optical Soc. Amer., vol. 2, no. 7, pp. 1,160-1,169, 1985.
[8] J.G. Daugman, “Complete Discrete 2D Gabor Transforms by Neural Networks for Image Analysis and Compression,” IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 36, no. 7, 1988.
[9] J.G. Daugman, "Quadrature-Phase Simple-Cell Pairs Are Appropriately Described in Complex Analytic Form," J. Optical Soc. Am., vol. 10, no. 7, pp. 375-377, 1993.
[10] R.L. De Valois, D.G. Albrecht, and L.G. Thorell, "Spatial Frequency Selectivity of Cells in Macaque Visual Cortex," Vision Research, vol. 22, pp. 545-559, 1982.
[11] R.L. De Valois and K.K. De Valois, Spatial Vision.New York: Oxford Univ. Press, 1988.
[12] R.J. Duffin and A.C. Schaeffer, "A Class of Nonharmonic Fourier Series," Trans. Am. Math. Soc., vol. 72, pp. 341-366, 1952.
[13] D. Gabor, "Theory of Communication," J. IEE, vol. 93, pp. 429-459, 1946.
[14] A. Grossmann, R. Kronland-Martinet, and J. Morlet, "Reading and Understanding Continuous Wavelet Transforms," Wavelets, J.M. Combes, A. Grossmann, and P. Tchamitchian, eds., pp. 2-20.Berlin: Springer-Verlag, 1989.
[15] C.E. Heil and D.F. Walnut, "Continuous and Discrete Wavelet Transforms," SIAM Review, vol. 31, no. 4, pp. 628-666, 1989.
[16] D.H. Hubel and T.N. Wiesel, "Functional Architecture of Macaque Monkey Visual Cortex," Proc. Royal Soc. B (London), vol. 198, pp. 1-59, 1978.
[17] J.P. Jones and L.A. Palmer, "An Evaluation of the Two-Dimensional Gabor Filter Model of Simple Receptive Fields in the Cat Striate Cortex," J. Neurophysiology, vol. 58, pp. 1,233-1,258, 1987.
[18] J.J. Kulikowski and P.O. Bishop, "Fourier Analysis and Spatial Representation in the Visual Cortex," Experientia, vol. 37, pp. 160-163, 1981.
[19] V.A.F. Lamme, "The Neurophysiology of Figure-Ground Segregation in Primary Visual Cortex," J. Neuroscience, vol. 10, no. 2, pp. 649-669, 1995.
[20] T.S. Lee, D. Mumford, and A.L. Yuille, "Texture Segmentation by Minimizing Vector-Valued Energy Functionals: The Couple-Membrane Model," Lecture Notes in Computer Science, 588, G. Sandini, ed., Computer Vision ECCV '92, pp. 165-173. Springer-Verlag, 1992.
[21] T.S. Lee, "A Bayesian Framework for Understanding the Texture Segmentation in the Primary Visual Cortex," Vision Research, vol. 35, no. 18, pp. 2,643-2,657, 1995.
[22] T.S. Lee, D. Mumford, and P.H. Schiller, "Neural Correlates of Boundary and Medial Axis Representations in Primate Visual Cortex." Invest. Opth. Vis. Sci, vol. 36, p. 477, 1995.
[23] T.S. Lee, V.A.F. Lamme, and D. Mumford, "The Role of V1 in Scene Segmentation and Shape Representation," unpublished manuscript.
[24] S.G. Mallat,“A theory for multiresolution signal decomposition: The wavelet representation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 7, pp. 674-693, 1989.
[25] S. Marcelja, "Mathematical Description of the Responses of Simple Cortical Cells," J. Optical Soc. Am., vol. 70, pp. 1,297-1,300, 1980.
[26] Y. Meyer, Wavelets and Operators.New York: Cambridge Univ. Press, 1992.
[27] J. Morlet, G. Arens, E. Fourgeau, and D. Giard, "Wave Propagation and Sampling Theory—Part II: Sampling Theory and Complex Waves," Geophysics, vol. 47, no. 2, pp. 222-236, 1982.
[28] J.A. Movshon and D.J. Tolhurst, "On the Response Linearity of Neurons in Cat Visual Cortex," J. Physiology (London), vol. 249, pp. 56P-57P, 1975.
[29] D. Mumford, "Neuronal Architectures for Pattern-Theoretic Problems," Large Scale Neuronal Theories of the Brain, C. Koch, ed. MIT Press, 1993.
[30] B.A. Olshausen and D.J. Field, "Emergence of Simple-Cell Receptive Field Properties By Learning a Sparse Code for Natural Images," Nature, vol. 381, pp. 607-609, 1996.
[31] L.M. Optican and B.J. Richmond, "Temporal Encoding of Two-Dimensional Patterns by Single Units in Primate Inferior Temporal Cortex. III. Information Theoretic Analysis," J. Neurophyisology, vol. 57, pp. 162-178, 1987.
[32] D.A. Pollen and S.E. Feldon, "Spatial Periodicities of Periodic Complex Cells in the Visual Cortex Cluster at One-Half Octave Intervals," Invest. Ophth. Vis. Sci, pp. 429-434, Apr. 1979.
[33] D.A. Pollen and S.F. Ronner, "Phase Relationship Between Adjacent Simple Cells in the Visual Cortex," Science, vol. 212, pp. 1,409-1,411, 1981.
[34] M. Porat and Y. Zeevi, "The Generalized Gabor Scheme of Image Representation in Biological and Machine Vision," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, no. 4, pp. 452-468, 1988.
[35] J. Segman and Y.Y. Zeevi, "A Wavelet-Type Approach to Image Analysis and Vision,"Brussels: NATO Book on Wavelets, Aug. 1992.
[36] M.S. Silverman, D.H. Grosof, R.L. De Valois, and S.D. Elfar, "Spatial-Frequency Organization in Primate Striate Cortex," Proc. Nat'l Academy of Science U.S.A., vol. 86, Jan. 1989.
[37] D.J. Tolhurst, "The Amount of Information Transmitted About Contrast by Neurons in the Cat's Visual Cortex," Visual Neuroscience, vol. 2, pp. 409-413, 1989.
[38] M.A. Webster and R.L. De Valois, "Relationship Between Spatial Frequency and Orientation Tuning of Striate Cortex Cells," J. Optical Soc. Am., vol. A2, no. 7, July 1985.
[39] G. Werner and V.B. Mountcastle, "Neural Activity in Mechano-Receptive Cutaneous Afferents: Stimulus-Response Relations, Weber Functions, and Information Transmission," J. Neurophysiology, vol. 28, pp. 359-397, 1965.

Index Terms:
Gabor wavelets, coarse coding, image representation, visual cortex, image reconstruction.
Tai Sing Lee, "Image Representation Using 2D Gabor Wavelets," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 18, no. 10, pp. 959-971, Oct. 1996, doi:10.1109/34.541406
Usage of this product signifies your acceptance of the Terms of Use.