This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Fast Multiresolution Image Operations in the Wavelet Domain
July-September 2003 (vol. 9 no. 3)
pp. 395-411

Abstract—A wide class of operations on images can be performed directly in the wavelet domain by operating on coefficients of the wavelet transforms of the images and other matrices defined by these operations. Operating in the wavelet domain enables one to perform these operations progressively in a coarse-to-fine fashion, operate on different resolutions, manipulate features at different scales, trade off accuracy for speed, and localize the operation in both the spatial and the frequency domains. Performing such operations in the wavelet domain and then reconstructing the result is also often more efficient than performing the same operation in the standard direct fashion. In this paper, we demonstrate the applicability and advantages of this framework to three common types of image operations: image blending, 3D warping of images and sequences, and convolution of images and image sequences.

[1] R. Basri and D. Jacobs, “Lambertian Reflectance and Linear Subspaces,” Proc. IEEE Int'l Conf. Computer Vision’01, pp. 383-389, 2001.
[2] G. Beylkin, On the Representation of Operators in Bases of Compactly Supported Wavelets SIAM J. Numerical Analysis, vol. 29, pp. 1716-1740, 1992.
[3] G. Beylkin, R. Coifman, and V. Rokhlin, Fast Wavelet Transforms and Numerical Algorithms I Comm. Pure Applied Math., vol. 44, pp. 141-183, 1991.
[4] P.J. Burt and E.H. Adelson, “The Laplacian Pyramid as a Compact Image Code,” IEEE Trans. Comm., vol. 31, no. 4, pp. 532-540, 1983.
[5] R. Calderbank, I. Daubechies, W. Sweldens, and B.-L. Yeo, Wavelet Transforms that Map Integers to Integers Applied and Computational Harmonic Analysis, vol. 5, no. 3, pp. 332-369, 1998.
[6] S.E. Chen, QuickTime VR An Image-Based Approach to Virtual Environment Navigation Computer Graphics Proc., Ann. Conf. Series (Proc. SIGGRAPH '95), pp. 29-38, 1995.
[7] S.E. Chen and L. Williams, View Interpolation for Image Synthesis Computer Graphics Proc., Ann. Conference Series (Proc. SIGGRAPH '93), pp. 279-288, 1993.
[8] A. Cohen, I. Daubechies, and J. Feauveau, Bi-Orthogonal Bases of Compactly Supported Wavelets Comm. Pure Applied Math., vol. 45, pp. 485-560, 1992.
[9] I. Cohen, S. Raz, and D. Malah, Orthonormal Shift-Invariant Wavelet Packet Decomposition and Representation Signal Processing, vol. 57, no. 3, pp. 251-270, Mar. 1997.
[10] W.J. Dally, L. McMillan, G. Bishop, and H. Fuchs, The Delta Tree: An Object-Centered Approach to Image-Based Rendering MIT AI Lab Technical Memo 1604, May 1996.
[11] I. Daubechies and W. Sweldens, Factoring Wavelet Transforms into Lifting Steps J. Fourier Analysis Applications, vol. 4, no. 3, pp. 245-267, 1998.
[12] P. Debevec, T. Hawkins, C. Tchou, H.-P. Duiker, W. Sarokin, and M. Sagar, Acquiring the Reflectance Field of a Human Face SIGGRAPH 2000, Computer Graphics Proc., K. Akeley, ed., pp. 145-156, 2000.
[13] R.A. DeVore, B. Jawerth, and B.J. Lucier, “Image Compression through Wavelet Transform Coding,” IEEE Trans. Information Theory, vol. 38, no. 2 (Part II)), pp. 719-746, 1992.
[14] A. Dorrell and D. Lowe, Fast Image Operation in Orthogonal and Overcomplete Wavelet Spaces Proc. Third Conf. Digital Image Computing Techniques and Applications, Dec. 1995.
[15] I. Drori and D. Lischinski, Wavelet Warping Proc. Rendering Techniques 2000, B. Péroche and H. Rushmeier, eds., pp. 113-124, June 2000.
[16] P. Duhamel and M. Vetterli, Fast Fourier Transforms: A Tutorial Review and a State of the Art Signal Processing, vol. 19, no. 4, pp. 259-299, Apr. 1990.
[17] P. Dutilleux, An Implementation of the 'AlgorithmeàTrous' to Compute the Wavelet Transform Wavelets: Time-Frequency Methods and Phase Space, Inverse Problems and Theoretical Imaging, J.-M. Combes, A. Grossman, and P. Tchamitchian, eds., pp. 298-304, Berlin: Springer-Verlag, 1989.
[18] R.C. Gonzalez and R.E. Woods, Digital Image Processing. Addison-Wesley, 1992.
[19] H. Guo and C.S. Burrus, Convolution Using the Undecimated Discrete Wavelet Transform Proc. Int'l Conf. Acoustics, Speech, Signal Processing (ICASSP-96), May 1996.
[20] M. Holschneider, R. Kronland-Martinet, J. Morlet, and P. Tchamitchian, A Real-Time Algorithm for Signal Analysis with the Help of the Wavelet Transform Wavelets: Time-Frequency Methods and Phase Space, Inverse Problems and Theoretical Imaging, J.-M. Combes, A. Grossman, and P. Tchamitchian, eds., pp. 286-297, Berlin: Springer-Verlag, 1989.
[21] S. Mallat, A Wavelet Tour of Signal Processing. Academic Press, 1998.
[22] W.R. Mark, L. McMillan, and G. Bishop, Post-Rendering 3D Warping Proc. 1997 Symp. Interactive 3D Graphics, Apr. 1997.
[23] L. McMillan, An Image-Based Approach to Three-Dimensional Computer Graphics PhD thesis, Dept. of Computer Science, Univ. of North Carolina at Chapel Hill, 1997.
[24] L. McMillan and G. Bishop, Plenoptic Modeling: An Image-Based Rendering System Computer Graphics Proc., Ann. Conf. Series (Proc. SIGGRAPH '95), pp. 39-46, 1995.
[25] J.S. Nimeroff, E. Simoncelli, and J. Dorsey, Efficient Re-Rendering of Naturally Illuminated Environments Proc. Fifth Eurographics Workshop Rendering, pp. 359-373, 1994.
[26] H.J. Nussbaumer, Fast Fourier Transform and Convolution Algorithms. Berlin: Springer-Verlag, 1982.
[27] J.M. Ogden, E.H. Adelson, J.R. Bergen, and P.J. Burt, Pyramid-Based Computer Graphics RCA Engineer, vol. 30, no. 5, pp. 4-15, 1985.
[28] R. Ramamoorthi and P. Hanrahan, An Efficient Representation for Irradiance Environment Maps Siggraph 2001, Computer Graphics Proc., 2001.
[29] R. Rao, Nonstandard Wavelet Decomposition of the Convolution and the Derivative Operators CNLS Newsletter, Sept. 1997. http://cnls.lanl.gov/Highlights1997-09/.
[30] J. Reichel, Complexity Related Aspects of Image Compression PhD thesis, Swiss Federal Inst. of Tech nology, Feb. 2001.
[31] A. Said and W.A. Pearlman, An Image Multiresolution Representation for Lossless and Lossy Image Compression IEEE Trans. Image Processing, vol. 5, no. 9, pp. 1303-1310, 1996.
[32] J.W. Shade, S.J. Gortler, L.-w. He, and R. Szeliski, Layered Depth Images Computer Graphics Proc., Ann. Conf. Series (Proc. SIGGRAPH '98), M. Cohen, ed., pp. 231-242, July 1998.
[33] M.J. Shensa, "The Discrete Wavelet Transform: Wedding theàTrous Algorithms and Mallat Algorithms," IEEE Trans. Signal Processing, vol. 40, no. 10, pp. 2,464-2,482, 1992.
[34] B.C. Smith and L.A. Rowe, "Algorithms for Manipulating Compressed Images," IEEE Computer Graphics and Applications, vol. 13, Sept. 1993.
[35] B.C. Smith and L.A. Rowe, Compressed Domain Processing of JPEG-Encoded Images Real-Time Imaging, vol. 2, pp. 3-17, 1996.
[36] E.J. Stollnitz, T.D. DeRose, and D.H. Salesin, Wavelets for Computer Graphics: Theory and Applications. San Francisco: Morgan Kaufmann, 1996.
[37] W. Sweldens, The Lifting Scheme: A Construction of Second Generation Wavelets SIAM J. Math. Analysis, vol. 29, no. 2, pp. 511-546, 1997.
[38] A. Zandi, M. Boliek, E.L. Schwartz, and M.J. Gormish, Crew Lossless/Lossy Medical Image Compression Technical Report CRC-TR-9526, RICOH California Research Center, 1995.
[39] 3DV Systems,http:/www.3dvsystems.com, 2000.

Index Terms:
Wavelets, image blending, 3D warping, image-based rendering, convolution, multiresolution operations, progressive computation.
Citation:
Iddo Drori, Dani Lischinski, "Fast Multiresolution Image Operations in the Wavelet Domain," IEEE Transactions on Visualization and Computer Graphics, vol. 9, no. 3, pp. 395-411, July-Sept. 2003, doi:10.1109/TVCG.2003.1207446
Usage of this product signifies your acceptance of the Terms of Use.