The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.04 - April (2013 vol.35)
pp: 849-862
A. Rajwade , DA-IICT, Gandhinagar, India
A. Rangarajan , Dept. of Comput. & Inf. Sci. & Eng., Univ. of Florida, Gainesville, FL, USA
A. Banerjee , Dept. of Comput. & Inf. Sci. & Eng., Univ. of Florida, Gainesville, FL, USA
ABSTRACT
In this paper, we propose a very simple and elegant patch-based, machine learning technique for image denoising using the higher order singular value decomposition (HOSVD). The technique simply groups together similar patches from a noisy image (with similarity defined by a statistically motivated criterion) into a 3D stack, computes the HOSVD coefficients of this stack, manipulates these coefficients by hard thresholding, and inverts the HOSVD transform to produce the final filtered image. Our technique chooses all required parameters in a principled way, relating them to the noise model. We also discuss our motivation for adopting the HOSVD as an appropriate transform for image denoising. We experimentally demonstrate the excellent performance of the technique on grayscale as well as color images. On color images, our method produces state-of-the-art results, outperforming other color image denoising algorithms at moderately high noise levels. A criterion for optimal patch-size selection and noise variance estimation from the residual images (after denoising) is also presented.
INDEX TERMS
Noise measurement, Transforms, Noise reduction, Image denoising, PSNR, Singular value decomposition, patch similarity, Image denoising, singular value decomposition (SVD), higher order singular value decomposition (HOSVD), coefficient thresholding, learning orthonormal bases
CITATION
A. Rajwade, A. Rangarajan, A. Banerjee, "Image Denoising Using the Higher Order Singular Value Decomposition", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 4, pp. 849-862, April 2013, doi:10.1109/TPAMI.2012.140
REFERENCES
[1] M. Aharon, M. Elad, and A. Bruckstein, "K-SVD: An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation," IEEE Trans. Signal Processing, vol. 54, no. 11, pp. 4311-4322, Nov. 2006.
[2] H. Andrews and C. Patterson, "Singular Value Decompositions and Digital Image Processing," IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 24, no. 1, pp. 26-53, Feb. 1976.
[3] S. Awate and R. Whitaker, "Unsupervised, Information-Theoretic, Adaptive Image Filtering for Image Restoration," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 3, pp. 364-376, Mar. 2006.
[4] A. Buades, B. Coll, and J.-M. Morel, "A Review of Image Denoising Algorithms, with a New One," Multiscale Modelling and Simulation, vol. 4, no. 2, pp. 490-530, 2005.
[5] A. Buades, B. Coll, and J.-M. Morel, "Neighborhood Filters and PDEs," Numerische Mathematik, vol. 105, no. 1, pp. 1-34, 2006.
[6] P. Chatterjee and P. Milanfar, "Clustering-Based Denoising with Locally Learned Dictionaries," IEEE Trans. Image Processing, vol. 18, no. 7, pp. 1438-1451, July 2009.
[7] R. Coifman and D. Donoho, "Translation-Invariant Denoising," technical report, Yale Univ., 1995.
[8] D. Comaniciu and P. Meer, "Mean Shift: A Robust Approach toward Feature Space Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, May 2002.
[9] K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, "Image Denoising by Sparse 3D Transform-Domain Collaborative Filtering," IEEE Trans. Image Processing, vol. 16, no. 8, pp. 2080-2095, Aug. 2007.
[10] K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, "BM3D Image Denoising with Shape-Adaptive Principal Component Analysis," Proc. Workshop Signal Processing with Adaptive Sparse Structured Representations, 2009.
[11] L. de Lathauwer, "Signal Processing Based on Multilinear Algebra," PhD dissertation, Katholieke Universiteit Leuven, Belgium, 1997.
[12] C. Ding and J. Ye, "Two-Dimensional Singular Value Decomposition (2DSVD) for 2D Maps and Images," Proc. SIAM Int'l Conf. Data Mining, pp. 32-43, 2005.
[13] D. Donoho and I. Johnstone, "Ideal Spatial Adaptation by Wavelet Shrinkage," Biometrika, vol. 81, pp. 425-455, 1993.
[14] K. Gurumoorthy, A. Rajwade, A. Banerjee, and A. Rangarajan, "A Method for Compact Image Representation Using Sparse Matrix and Tensor Projections onto Exemplar Orthonormal Bases," IEEE Trans. Image Processing, vol. 19, no. 2, pp. 322-334, Feb. 2010.
[15] A. Hyvarinen, P. Hoyer, and E. Oja, "Image Denoising by Sparse Code Shrinkage," Intelligent Signal Processing, pp. 1-6, IEEE Press, 1999.
[16] S. Lansel, "DenoiseLab," http://www.stanford.edu/~slansel/DenoiseLab documentation.htm, 2006.
[17] D. Letexier and S. Bourennane, "Adaptive Flattening for Multidimensional Image Restoration," IEEE Signal Processing Letters, vol. 15, pp. 229-232, 2008.
[18] M. Lewicki, T. Sejnowski, and H. Hughes, "Learning Overcomplete Representations," Neural Computation, vol. 12, pp. 337-365, 1998.
[19] J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Non-Local Sparse Models for Image Restoration," Proc. IEEE Int'l Conf. Computer Vision, pp. 2272-2279, 2009.
[20] J. Mairal, G. Sapiro, and M. Elad, "Learning Multiscale Sparse Representations for Image and Video Restoration," Multiscale Modeling and Simulation, vol. 7, no. 1, pp. 214-241, 2008.
[21] D. Muresan and T. Parks, "Adaptive Principal Components and Image Denoising," Proc. IEEE Int'l Conf. Image Processing, pp. 101-104, 2003.
[22] B. Olshausen and D. Field, "Emergence of Simple-Cell Receptive-Field Properties by Learning a Sparse Code for Natural Images," Nature, vol. 381, no. 6583, pp. 607-609, 1996.
[23] P. Perona and J. Malik, "Scale-Space and Edge Detection Using Anisotropic Diffusion," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 7, pp. 629-639, July 1990.
[24] K. Popat and R. Picard, "Cluster-Based Probability Model and Its Application to Image and Texture Processing," IEEE Trans. Image Processing, vol. 6, no. 2, pp. 268-284, Feb. 1997.
[25] J. Portilla, V. Strela, M. Wainwright, and E. Simoncelli, "Image Denoising Using Scale Mixtures of Gaussians in the Wavelet Domain," IEEE Trans. Image Processing, vol. 12, no. 11, pp. 1338-1351, Nov. 2003.
[26] A. Rangarajan, "Learning Matrix Space Image Representations," Proc. Int'l Conf. Energy Minimization Methods in Computer Vision and Pattern Recognition, pp. 153-168, 2001.
[27] A. Rosenfeld and A. Kak, Digital Picture Processing. Academic Press, 1982.
[28] L. Rudin and S. Osher, "Total Variation Based Image Resoration with Free Local Constraints," Proc. IEEE Int'l Conf. Image Processing, pp. 31-35, 1994.
[29] L. Sendur and I. Selesnick, "Bivariate Shrinkage Functions for Wavelet-Based Denoising Exploiting Interscale Dependency," IEEE Trans. Signal Processing, vol. 50, no. 11, pp. 2744-2756, Nov. 2002.
[30] E. Simoncelli, "Bayesian Denoising of Visual Images in the Wavelet Domain," Bayesian Inference in Wavelet Based Models, vol. 141, pp. 291-308, Springer-Verlag, 1999.
[31] O. Subakan, J. Bing, B. Vemuri, and E. Vallejos, "Feature Preserving Image Smoothing Using a Continuous Mixture of Tensors," Proc. IEEE Int'l Conf. Computer Vision, pp. 1-6, 2007.
[32] H. Takeda, S. Farsiu, and P. Milanfar, "Kernel Regression for Image Processing and Reconstruction," IEEE Trans. Image Processing, vol. 16, no. 2, pp. 349-366, Feb. 2007.
[33] C. Tomasi and R. Manduchi, "Bilateral Filtering for Gray and Color Images," Proc. IEEE Int'l Conf. Computer Vision, pp. 839-846, 1998.
[34] D. Tschumperlé and R. Deriche, "Vector-Valued Image Regularization with PDEs: A Common Framework for Different Applications," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 4, pp. 506-517, Apr. 2005.
[35] M. Vasilescu and D. Terzopoulos, "Multilinear Analysis of Image Ensembles: Tensorfaces," Proc. Int'l Conf. Pattern Recognition, pp. 511-514, 2002.
[36] Z. Wang, E. Simoncelli, and A. Bovik, "Multi-Scale Structural Similarity for Image Quality Assessment," Proc. IEEE Asilomar Conf. Signals, Systems, and Computers, pp. 1398-1402, 2003.
[37] J. Weickert, Anisotropic Diffusion in Image Processing. Teubner, 1998.
[38] L. Yaroslavsky, K. Egiazarian, and J. Astola, "Transform Domain Image Restoration Methods: Review, Comparison and Interpretation," Proc. SPIE Series, Nonlinear Processing and Pattern Analysis, pp. 1-15, 2001.
[39] J. Ye, "Generalized Low Rank Approximations of Matrices," Machine Learning, vol. 61, no. 1, pp. 167-191, 2005.
[40] Y. You and M. Kaveh, "Fourth Order Partial Differential Equations for Noise Removal," IEEE Trans. Image Processing, vol. 9, no. 10, pp. 1723-1730, Oct. 2000.
[41] G. Yu, G. Sapiro, and S. Mallat, "Solving Inverse Problems with Piecewise Linear Estimators: From Gaussian Mixture Models to Structured Sparsity," Computing Research Repository, 2010.
[42] D. Zhang and Z. Wang, "Image Information Restoration Based on Long-Range Correlation," IEEE Trans. Circuits and Systems in Video Technology, vol. 12, no. 5, pp. 331-341, May 2002.
[43] L. Zhang, W. Dong, D. Zhang, and G. Shi, "Two-Stage Image Denoising by Principal Component Analysis with Local Pixel Grouping," Pattern Recognition, vol. 43, no. 4, pp. 1531-1549, 2010.
[44] M. Zhou, "Nonparametric Bayesian Dictionary Learning for Analysis of Noisy and Incomplete Images," IEEE Trans. Image Processing, vol. 21, no. 1, pp. 130-144, Jan. 2012.
[45] M. Zhou, H. Yang, G. Sapiro, D.B. Dunson, and L. Carin, "Dependent Hierarchical Beta Process for Image Interpolation and Denoising," J. Machine Learning Research , vol. 15, pp. 883-891, 2011.
[46] D. Zoran and Y. Weiss, "From Learning Models of Natural Image Patches to Whole Image Restoration," Proc. IEEE Int'l Conf. Computer Vision, 2011.
44 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool