The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.06 - June (2013 vol.35)
pp: 1397-1409
Kaiming He , Microsoft Research Asia, Beijing
Jian Sun , Microsoft Research Asia, Beijing
Xiaoou Tang , The Chinese University of Hong Kong, Shatin
ABSTRACT
In this paper, we propose a novel explicit image filter called guided filter. Derived from a local linear model, the guided filter computes the filtering output by considering the content of a guidance image, which can be the input image itself or another different image. The guided filter can be used as an edge-preserving smoothing operator like the popular bilateral filter [1], but it has better behaviors near edges. The guided filter is also a more generic concept beyond smoothing: It can transfer the structures of the guidance image to the filtering output, enabling new filtering applications like dehazing and guided feathering. Moreover, the guided filter naturally has a fast and nonapproximate linear time algorithm, regardless of the kernel size and the intensity range. Currently, it is one of the fastest edge-preserving filters. Experiments show that the guided filter is both effective and efficient in a great variety of computer vision and computer graphics applications, including edge-aware smoothing, detail enhancement, HDR compression, image matting/feathering, dehazing, joint upsampling, etc.
INDEX TERMS
Image edge detection, Kernel, Smoothing methods, Joints, Histograms, Laplace equations, Jacobian matrices, linear time filtering, Edge-preserving filtering, bilateral filter
CITATION
Kaiming He, Jian Sun, Xiaoou Tang, "Guided Image Filtering", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 6, pp. 1397-1409, June 2013, doi:10.1109/TPAMI.2012.213
REFERENCES
[1] C. Tomasi and R. Manduchi, "Bilateral Filtering for Gray and Color Images," Proc. IEEE Int'l Computer Vision Conf., 1998.
[2] R.C. Gonzalez and R.E. Woods, Digital Image Processing, second ed. Prentice Hall, 2002.
[3] R. Fattal, D. Lischinski, and M. Werman, "Gradient Domain High Dynamic Range Compression," Proc. ACM Siggraph, 2002.
[4] P. Pérez, "Poisson Image Editing," Proc. ACM Siggraph, 2003.
[5] J. Sun, J. Jia, C.-K. Tang, and H.-Y. Shum, "Poisson Matting," Proc. ACM Siggraph, 2004.
[6] P. Bhat, B. Curless, M. Cohen, and C.L. Zitnick, "Fourier Analysis of the 2D Screened Poisson Equation for Gradient Domain Problems," Proc. European Conf. Computer Vision, pp. 114-128, 2008.
[7] P. Perona and J. Malik, "Scale-Space and Edge Detection Using Anisotropic Diffusion," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 7, pp. 629-639, July 1990.
[8] Z. Farbman, R. Fattal, D. Lischinski, and R. Szeliski, "Edge-Preserving Decompositions for Multi-Scale Tone and Detail Manipulation," Proc. ACM Siggraph, 2008.
[9] A. Levin, D. Lischinski, and Y. Weiss, "Colorization Using Optimization," Proc. ACM Siggraph, 2004.
[10] A. Levin, D. Lischinski, and Y. Weiss, "A Closed Form Solution to Natural Image Matting," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
[11] K. He, J. Sun, and X. Tang, "Single Image Haze Removal Using Dark Channel Prior," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[12] V. Aurich and J. Weule, "Non-Linear Gaussian Filters Performing Edge Preserving Diffusion," Mustererkennung 1995, 17. DAGM-Symp., pp. 538-545, 1995.
[13] S.M. Smith and J.M. Brady, "Susan—A New Approach to Low Level Image Processing," Int'l J. Computer Vision, vol. 23, pp. 45-78, 1995.
[14] G. Petschnigg, M. Agrawala, H. Hoppe, R. Szeliski, M. Cohen, and K. Toyama, "Digital Photography with Flash and No-Flash Image Pairs," Proc. ACM Siggraph, 2004.
[15] F. Durand and J. Dorsey, "Fast Bilateral Filtering for the Display of High-Dynamic-Range Images," Proc. ACM Siggraph, 2002.
[16] S. Bae, S. Paris, and F. Durand, "Two-Scale Tone Management for Photographic Look," Proc. ACM Siggraph, 2006.
[17] S. Paris and F. Durand, "A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach," Proc. European Conf. Computer Vision, 2006.
[18] F. Porikli, "Constant Time O(1) Bilateral Filtering," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[19] Q. Yang, K.-H. Tan, and N. Ahuja, "Real-Time O(1) Bilateral Filtering," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 557-564, 2009.
[20] A. Adams, N. Gelfand, J. Dolson, and M. Levoy, "Gaussian KD-Trees for Fast High-Dimensional Filtering," Proc. ACM Siggraph, pp. 21:1-21:12, 2009.
[21] A. Adams, J. Baek, and M.A. Davis, "Fast High-Dimensional Filtering Using the Permutohedral Lattice," Computer Graphics Forum, vol. 29, no. 2, pp. 753-762, 2010.
[22] K. He, J. Sun, and X. Tang, "Guided Image Filtering," Proc. European Conf. Computer Vision, pp. 1-14, 2010.
[23] C. Rhemann, A. Hosni, M. Bleyer, C. Rother, and M. Gelautz, "Fast Cost-Volume Filtering for Visual Correspondence and Beyond," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 3017-3024, 2011.
[24] L. De-Maeztu, S. Mattoccia, A. Villanueva, and R. Cabeza, "Linear Stereo Matching," Proc. IEEE Int'l Computer Vision Conf. pp. 1708-1715, 2011.
[25] Y. Ding, J. Xiao, and J. Yu, "Importance Filtering for Image Retargeting," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 89-96, 2011.
[26] P. Bauszat, M. Eisemann, and M. Magnor, "Guided Image Filtering for Interactive High-Quality Global Illumination," Computer Graphics Forum, vol. 30, no. 4, pp. 1361-1368, June 2011.
[27] K. He, "Guided Image Filtering (Matlab Code)," http://research. microsoft.com/en-us/um/ peoplekahe/, 2010.
[28] C. Liu, W.T. Freeman, R. Szeliski, and S.B. Kang, "Noise Estimation from a Single Image," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
[29] R. Fattal, M. Agrawala, and S. Rusinkiewicz, "Multiscale Shape and Detail Enhancement from Multi-Light Image Collections," Proc. ACM Siggraph, 2007.
[30] H. Winnemöller, S.C. Olsen, and B. Gooch, "Real-Time Video Abstraction," Proc. ACM Siggraph, 2006.
[31] J. Kopf, M. Cohen, D. Lischinski, and M. Uyttendaele, "Joint Bilateral Upsampling," Proc. ACM Siggraph, 2007.
[32] L. Yuan, J. Sun, L. Quan, and H.-Y. Shum, "Progressive Inter-Scale and Intra-Scale Non-Blind Image Deconvolution," Proc. ACM Siggraph, pp. 74:1-74:10, 2008.
[33] K.-J. Yoon and I.S. Kweon, "Adaptive Support-Weight Approach for Correspondence Search," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 4, pp. 650-656, Apr. 2006.
[34] B. Weiss, "Fast Median and Bilateral Filtering," ACM Trans. Graphics, vol. 25, no. 3, pp. 519-526, July 2006.
[35] J. Chen, S. Paris, and F. Durand, "Real-Time Edge-Aware Image Processing with the Bilateral Grid," ACM Trans. Graphics, vol. 26, no. 3, 2007.
[36] E.S.L. Gastal and M.M. Oliveira, "Adaptive Manifolds for Real-Time High-Dimensional Filtering," Proc. ACM Siggraph, 2012.
[37] R. Fattal, "Edge-Avoiding Wavelets and Their Applications," Proc. ACM Siggraph, 2009.
[38] E.S.L. Gastal and M.M. Oliveira, "Domain Transform for Edge-Aware Image and Video Processing," ACM Trans. Graphics, vol. 30, no. 4, pp. 69:1-69:12, 2011.
[39] L. Grady, "Random Walks for Image Segmentation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 11, pp. 1768-1783, Nov. 2006.
[40] Y. Saad, Iterative Methods for Sparse Linear Systems. SIAM, 2003.
[41] R. Szeliski, "Locally Adapted Hierarchical Basis Preconditioning," Proc. ACM Siggraph, 2006.
[42] W.L. Briggs, V.E. Henson, and S.F. McCormick, A Multigrid Tutorial, second ed. SIAM, 2000.
[43] M. Elad, "On the Origin of the Bilateral Filter and Ways to Improve It," IEEE Trans. Image Processing, vol. 11, no. 10, pp. 1141-1151, Oct. 2002.
[44] M. Kass and J. Solomon, "Smoothed Local Histogram Filters," ACM Trans. Graphics, vol. 29, pp. 100:1-100:10, July 2010.
[45] L.I. Rudin, S. Osher, and E. Fatemi, "Nonlinear Total Variation Based Noise Removal Algorithms," Physica D, vol. 60, nos. 1-4, pp. 259-268, Nov. 1992.
[46] Y. Li and S. Osher, "A New Median Formula with Applications to PDE Based Denoising," Comm. Math. Sciences, vol. 7, pp. 741-753, 2009.
[47] Y. Wang, J. Yang, W. Yin, and Y. Zhang, "A New Alternating Minimization Algorithm for Total Variation Image Reconstruction," SIAM J. Imaging Science, vol. 1, no. 3, pp. 248-272, 2008.
[48] S. Paris, S.W. Hasinoff, and J. Kautz, "Local Laplacian Filters: Edge-Aware Image Processing with a Laplacian Pyramid," ACM Trans. Graphics, vol. 30, no. 4, pp. 68:1-68:12, July 2011.
[49] L. Xu, C. Lu, Y. Xu, and J. Jia, "Image Smoothing via l0 Gradient Minimization," Proc. ACM Siggraph Asia, pp. 174:1-174:12, 2011.
[50] A. Zomet and S. Peleg, "Multi-Sensor Super Resolution," Proc. IEEE Workshop Applications of Computer Vision, 2002.
[51] N. Draper and H. Smith, Applied Regression Analysis, second ed. John Wiley, 1981.
[52] T. Hastie, R. Tibshirani, and J.H. Friedman, The Elements of Statistical Learning. Springer, 2003.
[53] V. Katkovnik, A. Foi, K. Egiazarian, and J. Astola, "From Local Kernel to Nonlocal Multiple-Model Image Denoising," Int'l J. Computer Vision, vol. 86, no. 1, pp. 1-32, 2010.
[54] K. Dabov, R. Foi, V. Katkovnik, and K. Egiazarian, "Image Denoising by Sparse 3D Transform-Domain Collaborative Filtering," IEEE Trans. Image Processing, vol. 16, no. 8, pp. 2080-2095, Aug. 2007.
[55] K. He, J. Sun, and X. Tang, "Fast Matting Using Large Kernel Matting Laplacian Matrices," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2165-2172, 2010.
[56] S. Perreault and P. Hébert, "Median Filtering in Constant Time," IEEE Trans. Image Processing, vol. 16, no. 9, pp. 2389-2394, Sept. 2007.
[57] F. Crow, "Summed-Area Tables for Texture Mapping," Proc. ACM Siggraph, 1984.
[58] R. Deriche, "Recursively Implementing the Gaussian and Its Derivatives," 1993.
[59] K. He, C. Rhemann, C. Rother, X. Tang, and J. Sun, "A Global Sampling Method for Alpha Matting," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2049-2056, 2011.
37 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool