This Article 
 Bibliographic References 
 Add to: 
Visualization of Multidimensional Shape and Texture Features in Laser Range Data Using Complex-Valued Gabor Wavelets
March 1995 (vol. 1 no. 1)
pp. 44-59

Abstract—This paper describes a new method for visualization and analysis of multivariate laser range data using complex-valued non-orthogonal Gabor wavelets, principal component analysis and a topological mapping network. The initial data set that provides both shape and texture information is encoded in terms of both amplitude and phase of a complex valued 2D image function. A set of carefully designed oriented Gabor filters performs a decomposition of the data and allows for retrieving local shape and texture features. The feature vector obtained from this method is multidimensional and in order to evaluate similar data features, further subspace methods to transform the data onto visualizable attributes, such as R, G, B, have to be determined. For this purpose, a feature-based visualization pipeline is proposed consisting of principal component analysis, normalization and a topological mapping network. This process finally renders a R, G, B subspace representation of the multidimensional feature vector. Our method is primarily applied to the visual analysis of features in human faces_but is not restricted to that.

[1] A.N. Akansu and R.A. Haddad, Multiresolution Signal Decomposition.San Diego, Calif.: Academic Press, 1992.
[2] J. Aloimonos and D. Shulman,New York: Academic Press, 1989.
[3] A. Benedetto,J. Frazier,Wavelets: Mathematics and Applications.New York: CRC Press, 1994.
[4] D. Bergeron and G. Grinstein,“A reference model for the visualization of multi-dimensional data,” Proc. of the EuroGraphics’89.New York: Elsevier North-Holland, pp. 393-399, 1989.
[5] P.J. Besl and R.C. Jain, “Invariant Surface Characteristics for 3D Object Recognition in Range Images,” Computer Vision Graphics and Image Processing. vol. 33, no. 1, pp. 33-80, Jan. 1986.
[6] W. Bohm, G. Farin, and J. Kahmann, "A Survey of Curve and Surface Methods in CAGD," Computer Aided Geometric Design, pp. 1-60, 1984.
[7] A.C. Bovik,M. Clark,, and W.S. Geisler,“Multichannel texture analysis using localized spatial filters,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, pp. 55-73, 1990.
[8] J. Buhmann, J. Lange, and C. von der Malsburg, “Distortion Invariant Object Recognition—Matching Hierarchically Labelled Graphs,” Proc. Int'l Joint Conf. Neural Networks, pp. 155-159, 1989.
[9] C. Busch and M. Gross,“Interactive neural network texture analysis and visualization for surface reconstruction in medical imaging,” Computer Graphics Forum, vol. 12, no. 3, pp. C49-C60, 1993.
[10] R. Buse and Z. Liu,“Feature extraction and analysis of handwritten words in grey-scale images using gabor filters,” Proc. First IEEE Conf. on Image Processing, vol. 1, pp. 164-168, 1994.
[11] T. Chang and C.-C.J. Kuo, "Texture Analysis and Classification With Tree-Structured Wavelet Transform," IEEE Trans. Image Processing, vol. 2, no. 4, pp. 429-441, Oct. 1993.
[12] C.K. Chui, An Introduction to Wavelets.Boston: Academic Press, 1992.
[13] Wavelets: A Tutorial in Theory and Applications, C. Chui, ed. Boston: Academic Press, 1992.
[14] I. Daubechies,“The wavelet transform, time-frequency localization, and signal analysis,” IEEE Trans. Information Theory, vol. 36, pp. 961-1,005, 1990.
[15] J.G. Daugman,“High confidence visual recognition of persons by a test of statistical independence,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 11, pp. 1,148-1,161, Nov. 1993.
[16] J.G. Daugman,“Two-dimensional spectral analysis of cortical receptive field profiles,” Vision Research, vol. 20, pp. 847-856, 1980.
[17] R. Duda and P. Hart,Pattern Classification and Scene Analysis.New York: John Wiley and Sons, 1973.
[18] G. Farin,Curves and Surfaces for Computer Aided Geometric Design, 3rd ed. New York: Academic Press, 1992.
[19] R. Franke and G. Nielson,“Scattered data interpolation and applications: A tutorial and survey,” H. Hagen and D. Roller, eds., Geometric Modeling: Methods and Their Applications.Berlin: Springer, 1990, pp. 131-160.
[20] K. Fukunaga, Introduction to Statistical Pattern Recognition, second edition. Academic Press, 1990.
[21] D. Gabor,“Theory of communication,” J. Inst. Electrical Eng., vol. 93, pp. 429-457, 1946.
[22] M. Gross,Visual Computing.Berlin: Springer, 1994.
[23] M. Gross,“Subspace methods for the visualization of multidimensional data sets,” L. Rosenblum, R. Earnshaw, J. Encarnacao H. Hagen, A. Kaufman, S. Klimenko, G. Nielson, F. Post, and D. Thalmann, eds., Scientific Visualization: Advances and Challenges.New York: Academic Press, 1994, pp. 171-186.
[24] M. Gross,“Integrated volume rendering and data analysis in wavelet space,” Proc. Dagstuhl Symp. on Scientific Visualization, to appear.
[25] M.H. Gross, R. Koch, L. Lippert, and A. Dreger, "Multiscale Image Texture Analysis in Wavelet Spaces," Proc. IEEE Int'l Conf. Image Processing, 1994.
[26] M. Gross,R. Koch,L. Lippert,, and A. Dreger,“A new method to approximate the volume rendering equation using wavelets and piecewise polynomials,” Computers&Graphics, to appear.
[27] M. Gross and H. Luttermann,“Combining principal component analysis and neural networks for the recognition of human faces—a case study for man-machine-communication,” Proc. of Pacific Graphics.Singapore: World Scientific, 1993, pp. 176-192.
[28] M. Gross and F. Seibert,“Visualization of multidimensional data sets using a neural network,” The Visual Computer, vol. 10, no. 3, pp. 145-59, 1993.
[29] A. Grossmann and J. Morlet,“Decomposition of hardy functions into square integrable wavelets of constant shape,” SIAM J. Math. Anal., vol. 15, pp. 723-736, 1984.
[30] H. Hagen,“Visualization of large data sets,” L. Rosenblum, R. Earnshaw, J. Encarnacao, H. Hagen, A. Kaufman, S. Klimenko, G. Nielson, F. Post, and D. Thalmann, eds., Scientific Visualization: Advances and Challenges.New York: Academic Press, pp. 187-198, 1994.
[31] P. Hanrahan and W. Krueger, “Reflection from Layered Surfaces due to Subsurface Scattering,” Computer Graphics, pp. 165-174, 1993.
[32] R.M. Haralick and L.G. Shapiro, Computer and Robot Vision. New York: Addison-Wesley, 1993.
[33] L. Harmon,M. Kahn,R. Lasch,, and P. Ramig,“Machine identification of human faces,” Pattern Recognition, vol. 13, no. 2, pp. 97-110, 1981.
[34] T. He, S. Wang, and A. Kaufman, "Wavelet-Based Volume Morphing," Proc. Visualization 94, IEEE Computer Society Press, Los Alamitos, Calif., 1994, pp. 85-92.
[35] L. Hessellkink and T. Delmarcelle,“Visualization of vector and tensor data sets,” L. Rosenblum, R. Earnshaw, J. Encarnacao, H. Hagen, A. Kaufman, S. Klimenko, G. Nielson, F. Post, and D. Thalmann, eds., Scientific Visualization.New York: Academic Press, pp. 419-433, 1994.
[36] A.K. Jain, Fundamentals of Digital Image Processing. Prentice Hall, 1989.
[37] B. Jawerth and W. Swendens,“An overview of wavelet based multiresolution analyses,” Univ. of South Carolina, Dept. of Math., internal report, 1994.
[38] T. Kohonen,“The self-organizing map,” Proc. IEEE, vol. 78, no. 9, pp. 1464-1480, 1990.
[39] A. Laine and J. Fan, “Texture Classification by Wavelet Packet Signature,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 11, pp. 1,186-1,191, Nov. 1993.
[40] T. Lillesand and R. Kiefer,Remote Sensing and Image Interpretation, 2nd. ed. New York: John Wiley, 1987.
[41] S.G. Mallat,“A theory for multiresolution signal decomposition: The wavelet representation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 7, pp. 674-693, 1989.
[42] D. Marr,Vision.San Francisco: Freeman, 1982.
[43] Visualization in Scientific Computing. ACM Computer Graphics (special issue), B.H. McCormick, T.A. DeFanti, and M.D. Brown, eds., vol. 21, no. 6, 1987.
[44] S. Muraki,“Volumetric shape description of range data using’blobby model’,” Proc. SIGGRAPH’91 (Las Vegas, Nevada, July 29-Aug. 2, 1991). In Computer Graphics, vol. 25, no. 4, pp. 227-235, 1991.
[45] S. Muraki,“Multiscale 3D edge representation of volume data by a DoG wavelet,” Proc. 1994 Symp. on Volume Visualization, pp. 35-42, 1994.
[46] H. Murase and S. K. Nayar,“Learning object models from appearance,” Proc. Nat’l Conf. Artificial Intelligence, pp. 836-843, 1993.
[47] G.M. Nielson, “Scattered Data Modeling,” IEEE CG&A, Vol. 13, No. 1, Jan. 1993, pp. 60-70.
[48] G. M. Nielson,“Visualization in scientific and engineering computation,” IEEE Computer, vol. 9, pp. 58-66, 1991.
[49] A. Pentland,“Equilibrium and interpolation solutions using wavelet bases,” Proc. of the CGI’91.New York: Springer, 1991, pp. 507-523.
[50] Scientific Visualization: Advances and Challenges, L. Rosenblum, R. Earnshaw, J. Encarnacao, H. Hagen, A. Kaufman, S. Klimenko, G. Nielson, F. Post, and D. Thalmann, eds. New York: Academic Press, 1994.
[51] S.J. Gortler, P. Schroder, M.F. Cohen, and P. Hanrahan, "Wavelet Radiosity," Computer Graphics Proc., Ann. Conf. Series: SIGGRAPH '93,Anaheim, Calif., pp. 221-230, Aug. 1993.
[52] E.P. Simoncelli and E.H. Adelson,“Non-separable extensions of quadrature mirror filters to multiple dimensions,” Proc. IEEE, vol. 78, no. 4, pp. 652-664, 1990.
[53] T. Tanaka and F. Kishimo,“Recordering and visualizing complex shape from range data,” Proc. CGI’92.Tokyo: Springer, pp. 331-348, 1992.
[54] T. Totsuka and M. Levoy,“Frequency domain volume rendering,” Computer Graphics, vol. 27, pp. 271-278, Aug. 1993.
[55] M. Unser and M. Eden,“Multiresolution feature extraction and selection for texture segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 7, pp. 717-728, 1989.
[56] L. Orozco-Barosa et al., “A Multimedia Interhospital Communications System for Medical Consultations,” IEEE J. on Selected Areas in Communications, Vol. 10, No. 7, Sept. 1992, pp. 1145‐1156.
[57] M. Vannier,T. Pilgram,G. Bhatia,, and B. Brunsden,“Facial surface scanner,” IEEE Computer Graphics and Applications, vol. 11, no. 6, pp. 72-80, 1991.
[58] M. Vetterelli and C. Herley, Wavelets and Filter Banks: Theory and Design IEEE Trans. Signal Processing, vol. 40, pp. 2207-2232, 1992.
[59] Y. Watanabe and Y. Suenaga,“Synchronized acquisition of three-dimensional range and color data and its applications,” Proc. CGI’91.Berlin: Springer, pp. 655-665, 1991.
[60] R. Westermann, "A Multiresolution Framework for Volume Rendering," Proc. ACM Workshop on Volume Visualization, ACM Press, 1994, pp. 51-57.
[61] G. Wyszecki and W. Stiles,Color Science. Concepts and Methods, Quantitative Data and Formulae, 2nd ed. New York: John Wiley and Sons, 1991.
[62] N. Yokoya and M. Levine,“Range image segmentation based on differential geometry: a hybrid approach,” IEEE Trans. on PAMI, vol. 11, no. 6, pp. 643-649, Jun. 1989.
[63] F.W. Young and P. Rheingans, Visualizing Structure in High-Dimensional Multivariate Data IBM J. Research and Development, vol. 35, nos. 1/2, pp. 97-107, Jan./Mar. 1991.

Index Terms:
Feature-based visualization, feature extraction, wavelet transform, Gabor wavelets, multidimensional visualization, subspace mapping, principal components, shape, and texture analysis.
Markus H. Gross, Rolf Koch, "Visualization of Multidimensional Shape and Texture Features in Laser Range Data Using Complex-Valued Gabor Wavelets," IEEE Transactions on Visualization and Computer Graphics, vol. 1, no. 1, pp. 44-59, March 1995, doi:10.1109/2945.468389
Usage of this product signifies your acceptance of the Terms of Use.