This Article 
 Bibliographic References 
 Add to: 
The Generalized Gabor Scheme of Image Representation in Biological and Machine Vision
July 1988 (vol. 10 no. 4)
pp. 452-468

A scheme suitable for visual information representation in a combined frequency-position space is investigated through image decomposition into a finite set of two-dimensional Gabor elementary functions (GEF). The scheme is generalized to account for the position-dependent Gabor-sampling rate, oversampling, logarithmic frequency scaling and phase-quantization characteristic of the visual system. Comparison of reconstructed signal highlights the advantages of the generalized Gabor scheme in coding typical bandlimited images. It is shown that there exists a tradeoff between the number of frequency components used per position and the number of such clusters (sampling rate) utilized along the spatial coordinate.

[1] R. E. Kronauer and Y. Y. Zeevi, "Reorganization and diversification of signals in vision,"IEEE Trans. Syst., Man, Cybern, vol. SMC- 15, no. 1, pp. 91-101, 1985.
[2] C. Mead and L. Conway,Introduction to VLSI Systems. Reading, MA: Addison-Wesley, 1980, pp. 150-152.
[3] D. H. Hubel, "Exploration of the primary visual cortex, 1955-78,"Nature, vol. 299, no. 5883, pp. 515-524, 1982.
[4] D. Gabor, "Theory of communication,"J.I.E.E., vol. 93, pp. 429- 459, 1946.
[5] P. J. Burt and E.H. Adelson, "The Laplacian pyramid as a compact image code,"IEEE Trans. Commun., vol. COM-31, pp. 532-540, Apr. 1983.
[6] A. Rosenfeld, Ed.,Multiresolution Image Processing and Analysis. New York: Springer-Verlag, 1984.
[7] J. Daugman, "Image analysis by local 2-D spectral signatures,"J. Opt. Soc. Amer. (A), vol. 2, p. 74, 1985.
[8] J. R. Higgins,Completeness and Basis Properties of Sets of Special Functions. London: Cambridge University Press, 1977.
[9] J. Daugman, "Two dimensional spectral analysis of cortical receptive field profiles,"Vision Res., vol. 20, pp. 847-856, 1980.
[10] S. Marcelja, "Mathematical description of the responses of simple cortical cells,"J. Opt. Soc. Amer., vol. 70, no. 11, pp. 1297-1300, 1980.
[11] J. J. Kulikowski, S. Marcelja, and P. O. Bishop, "Theory of spatial position and spatial frequency relations in the receptive field of simple cells in the visual cortex,"Biol. Cybern., vol. 43, pp. 187-198, 1982.
[12] B. Sakitt and H. B. Barlow, "A model for the economical encoding of the visual image in cerebral cortex,"Biol. Cybern., 43, pp. 97- 108, 1982.
[13] D. A. Pollen and S. F. Ronner, "Visual cortical neurons as localized spatial frequency filter,"IEEE Trans. Syst., Man, Cybern., vol. SMC-13, no. 5, pp. 907-916, 1983.
[14] D. A. Pollen and S. F. Ronner, "Phase relationship between adjacent simple cells in the visual cortex,"Science, vol. 212, pp. 1409-1411, 1982.
[15] J. Daugman, "Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by 2D visual cortical filters,"J. Opt. Soc. Amer. (A), vol. 2, no. 7, pp. 1160-1169, 1985.
[16] F. W. Campbell and J. G. Robson, "Application of Fourier analysis to the visibility of gratings,"J. Physiol.(London), vol. 197, pp. 551-556, 1968.
[17] N. Graham and J. N. Nachmias, "Detection of grating pattern containing two spatial frequencies: A comparison of single-channel and multiple-channel models,"Vision Res., vol. 11, pp. 251-259, 1971.
[18] O. Braddick, F. W. Campbell, and J. Atkinson, "Channels in vision: Basic aspects," inHandbook of Sensory Physiology, vol. VIII, 1978.
[19] D. M. Mackay, "Strife over visual cortical function,"Nature, vol. 289, pp. 117-118, 1981.
[20] Y. Y. Zeevi and J. Daugman, "Some psychophysical aspects of visual processing of displayed information," inProc. Image II Conf., Phoenix, AZ, pp. 260-267, 1982.
[21] A. B. Watson, "Detection and recognition of simple spatial forms," NASA, Ames Res. Center, Moffett Field, CA, Tech. Mem., 84353, 1983.
[22] R. E. Kronauer, personal communication.
[23] Y. Y. Zeevi and M. Porat, "Computer image generation using elementary functions matched to human vision," inTheoretical Foundations of Computer Graphics and CAD, R. A. Earnshaw, Ed. Berlin: Springer-Verlag, 1988, pp. 1197-1241.
[24] M. J. Bastiaans, "A sampling theorem for the complex spectrogram and Gabor expansion of a signal into Gaussian elementary signals,"Opt. Eng., vol. 20, no. 4, pp. 594-598, 1981.
[25] Y. Y. Zeevi and M. Porat, "Combined frequency-position scheme of image representation in vision,"J. Opt. Soc. Amer. (A), vol. 1, no. 12, p. 1248, 1984.
[26] M. Porat and Y. Y. Zeevi, "The generalized Gabor scheme of image representation,"ACTA Polytechnica Scand. Appl. Phys., no. 150, pp. 166-199, June 1985.
[27] A. J. E. M. Janssen, "Gabor representation and Wigner distribution of signals," inProc. Int. Conf. Accoust. Speech, Signal Processing, 1984, p. 41B.
[28] A. J. E. M. Janssen, "Bargmann transform, Zak transform, and coherent states,"J. Math. Phys., vol. 23, no. 5, pp. 720-731, 1982.
[29] T. Caelli and P. Beven, "Visual sensitivity to two dimensional spatial phase,"J. Opt. Soc. Amer., vol. 72, no. 10, pp. 1375-1381, 1982.
[30] A. V. Oppenheim and J. S. Lim, "The importance of phase in signals,"Proc. IEEE, vol. 69, no. 5, pp. 529-541, 1981.
[31] J. W. Goodman and A. M. Silvestri, "Some effects of Fourier-domain phase quantization,"IBM J. Res. Develop., vol. 14, pp. 478- 484, 1970.
[32] H. Gafni and Y. Y. Zeevi, "A model for separation of spatial and temporal information in the visual system,"Biol. Cybern., vol. 28, pp. 73-82, 1977.
[33] K. Horiuchi, "Sampling principle for continuous signals with time-varying bands,"Inform. Cont., vol. 13, pp. 53-61, 1968.
[34] J. J. Koenderink and A. J. van Doorn, "Visual detection of spatial contrast,"Biol. Cybern., vol. 30, pp. 157-167, 1978.
[35] D. Marr,Vision, San Fransisco, CA: W. H. Freeman, 1982.
[36] M. J. Davis and E. J. Heller, "Semiclassical Gaussian basis set method for molecular vibrational wave functions,"J. Chem. Phys., vol. 71, no. 8, pp. 3383-3395, 1979.
[37] J. Morlet, G. Arens, E. Fourgeau, and D. Giand, "Wave propagation and sampling theory,"Geophysics, vol. 47, no. 2, pp. 203-236, 1982.
[38] M. Porat and Y. Y. Zeevi, "The generalized Gabor scheme of image representation in vision," Dep. Elec. Eng., Technion. EE Rep. 519, Mar. 1985.
[39] M. A. Fischetti and C. Truxal, "Simulating the right stuff,"IEEE Spectrum, vol. 22, no. 3, pp. 38-47, 1985.
[40] E. Schwartz, "Computational anatomy and functional architecture of striate cortex: A spatial mapping approach to perceptual coding,"Vision Res., vol. 20, pp. 645-669, 1980.
[41] R. B. H. Tootell, M. S. Silverman, E. Switkes, and R. L. Devalois, "Deoxyglucose analysis of retinotopic organization in primate striate cortex,"Science, vol. 218, pp. 902-904, 1982.
[42] G. Rodrigue, Ed.,Parallel computations. New York: Academic, 1982.
[43] P. D. Einziger and Y. Hertzberg, "On the Gabor representation and its digital implementation," Dep. Elec. Eng., Technion, EE Publ. 587, 1986.
[44] Y. Y. Zeevi and M. Porat, "The Phasogram--Image representation by localized phase,"J. Opt. Soc. Amer. (A), vol. 3, no. 13, p. 115, 1986.
[45] E. Walach, E. Karnin, and D. Chevion, "On fractal based approach to image coding," inSignal Processing III: Theories and Applications, I. T. Younget al., Eds. Amsterdam, The Netherlands: Elsevier, 1986.
[46] E. Wigner, "On the quantum correction for thermodynamic equilibrium,"Phys. Rev., vol. 40, pp. 749-759, 1932.
[47] P. M. Woodward,Probability and Information Theory, with Applications to Radar. New York: McGraw-Hill, 1953.
[48] L. Jacobson and H. Wechsler, "A theory for invariant object recognition in the frontoparallel plane,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, pp. 325-331, May 1984.
[49] R. A. Young, "The Gaussian derivative theory of spatial vision: Analysis of cortical cell receptive field line-weighting profiles," General Motors, Rep. GMR-4920, May 1985.

Index Terms:
biological vision; 2D Gabor elementary functions; picture processing; pattern recognition; Gabor scheme; image representation; machine vision; frequency-position space; image decomposition; frequency scaling; phase-quantization; coding; clusters; sampling; pattern recognition; picture processing
M. Porat, Y.Y. Zeevi, "The Generalized Gabor Scheme of Image Representation in Biological and Machine Vision," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 10, no. 4, pp. 452-468, July 1988, doi:10.1109/34.3910
Usage of this product signifies your acceptance of the Terms of Use.