CSDL Home IEEE Transactions on Pattern Analysis & Machine Intelligence 2011 vol.33 Issue No.03 - March

Subscribe

Issue No.03 - March (2011 vol.33)

pp: 485-499

Nicholas Dowson , Royal Brisbane and Women's Hospital, Herston

Olivier Salvado , Royal Brisbane and Women's Hospital, Herston

ABSTRACT

Denoising algorithms can alleviate the trade-off between noise-level and acquisition time that still exists for certain image types. Nonlocal means, a recently proposed technique, outperforms other methods in removing noise while retaining image structure, albeit at prohibitive computational cost. Modifications have been proposed to reduce the cost, but the method is still too slow for practical filtering of 3D images. This paper proposes a hashed approach to explicitly represent two summed frequency (hash) functions of local descriptors (patches), utilizing all available image data. Unlike other approaches, the hash spaces are discretized on a regular grid, so primarily linear operations are used. The large memory requirements are overcome by recursing the hash spaces. Additional speed gains are obtained by using a marginal linear interpolation method. Careful choice of the patch features results in high computational efficiency, at similar accuracies. The proposed approach can filter a 3D image in less than a minute versus 15 minutes to 3 hours for existing nonlocal means methods.

INDEX TERMS

Nonlocal means, image filtering.

CITATION

Nicholas Dowson, Olivier Salvado, "Hashed Nonlocal Means for Rapid Image Filtering",

*IEEE Transactions on Pattern Analysis & Machine Intelligence*, vol.33, no. 3, pp. 485-499, March 2011, doi:10.1109/TPAMI.2010.114REFERENCES

- [1] P. Perona and J. Malik, "Scale Space and Edge Detection Using Anisotropic Diffusion,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 7, pp. 629-639, July 1990.- [2] S.M. Smith and J.M. Brady, "Susan—A New Approach to Low Level Image Processing,"
Int'l J. Computer Vision, vol. 23, pp. 45-78, 1997.- [3] C. Tomasi and R. Manduchi, "Bilateral Filtering for Gray and Color Images,"
Proc. Int'l Conf. Computer Vision, pp. 839-846, 1998.- [4] C.K. Chu, I. Glad, F. Godtliebsen, and J.S. Marron, "Edge Preserving Smoothers for Image Processing,"
J. Am. Statistical Assoc., vol. 93, no. 442, pp. 526-556, 1998.- [5] Y. Cheng, "Mean Shift, Mode Seeking and Clustering,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 8, pp. 790-799, Aug. 1995.- [6] S. Awate and R. Whitaker, "Higher-Order Image Statistics for Unsupervised, Information-Theoretic, Adaptive, Image Filtering,"
Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 44-51, June 2005.- [7] P. Mrazek, J. Weickert, and A. Bruhn, "On Robust Estimation and Smoothing with Spatial and Tonal Kernels,"
Geometric Properties from Incomplete Data, R. Klette, R. Kozera, L. Noakes, and J. Weickert, eds., vol. 3, pp. 335-352, Springer, 2006.- [8] A. Buades, B. Coll, and J. Morel, "A Non-Local Algorithm for Image Denoising,"
Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 60-65, June 2005.- [9] A. Buades, B. Coll, and J. Morel, "Nonlocal Image and Movie Denoising,"
Int'l J. Computer Vision, vol. 76, no. 2, pp. 123-139, Feb. 2008.- [10] S. Awate and R. Whitaker, "Unsupervised, Information-Theoretic, Adaptive Image Filtering for Image Restoration,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 3, pp. 364-376, Mar. 2006.- [11] D. Comaniciu and P. Meer, "Mean Shift: A Robust Approach Toward Feature Space Analysis,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, May 2002.- [12] K. Fukunaga and L. Hostetler, "The Estimation of the Gradient of the Density Function with Applications to Pattern Recognition,"
IEEE Trans. Information Theory, vol. 21, no. 1, pp. 32-40, 1975.- [13] E. Parzen, "On the Estimation of a Probability Density Function and the Mode,"
Annals of Math. Statistics, vol. 33, pp. 1065-1076, 1962.- [14] D. Muresan and T. Parks, "Adaptive Principal Components and Image Denoising,"
Proc. Int'l Conf. Image Processing, vol. 1, pp. 101-104, Sept. 2003.- [15] N. Azzabou, N. Paragios, and F. Guichard, "Random Walks, Constrained Multiple Hypotheses Testing and Image Enhancement,"
Proc. Ninth European Conf. Computer Vision, vol. 1, pp. 379-390, May 2006.- [16] K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, "Image Denoising by Sparse 3D Transform-Domain Collaborative Filtering,"
IEEE Trans. Image Processing, vol. 16, no. 8, pp. 2080-2095, Aug. 2007.- [17] S.G. Narasimhan and S.K. Nayar, "Enhancing Resolution Along Multiple Imaging Dimensions Using Assorted Pixels,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 4, pp. 518-530, Apr. 2005.- [18] A.A. Efros and T.K. Leung, "Texture Synthesis by Non-Parametric Sampling,"
Proc. IEEE Int'l Conf. Computer Vision, pp. 1033-1038, Sept. 1999.- [19] M. Mahmoudi and G. Sapiro, "Fast Image and Video Denoising via Nonlocal Means of Similar Neighborhoods,"
IEEE Signal Processing Letters, vol. 12, no. 12, pp. 839-842, Dec. 2005.- [20] N. Wiest-Daessle, S. Prima, P. Coup, S.P. Morrissey, and C. Barillot, "Rician Noise Removal by Non-Local Means Filtering for Low Signal to Noise Ratio MRI: Applications to DT-MRI,"
Proc. Int'l Conf. Medical Image Computing and Computer Assisted Intervention, vol. 2, pp. 171-179, Sept. 2008.- [21] P. Coupe, P. Yger, S. Prima, P. Hellier, C. Kervrann, and C. Barillot, "An Optimized Blockwise Nonlocal Means Denoising Filter for 3D Magnetic Resonance Images,"
IEEE Trans. Medical Imaging, vol. 27, no. 4, pp. 425-441, Apr. 2008.- [22] D.I. Barnea and H.F. Silverman, "A Class of Algorithm for Fast Digital Image Registration,"
IEEE Trans. Computers, vol. 21, no. 2, pp. 179-186, Feb. 1972.- [23] H.-C. Huang and Y.-P. Hung, "Adaptive Early Jump-Out Technique for Fast Motion Estimation in Video Coding,"
Graphical Models and Image Processing, vol. 59, no. 6, pp. 388-394, Nov. 1997.- [24] T. Brox, O. Kleinschmidt, and D. Cremers, "Efficient Nonlocal Means for Denoising of Textural Patterns,"
IEEE Trans. Medical Imaging, vol. 17, no. 7, pp. 1083-1092, July 2008.- [25] S. Paris and F. Durand, "A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach,"
Proc. European Conf. Computer Vision, vol. 4, pp. 24-52, May 2006.- [26] C. Kervrann and J. Boulanger, "Local Adaptivity to Variable Smoothness for Exemplar-Based Image Regularisation and Representation,"
Int'l J. Computer Vision, vol. 79, pp. 45-69, 2008.- [27] H. Nyquist, "Regeneration Theory,"
Bell System Technical J., vol. 11, pp. 126-147, 1932.- [28] C.E. Shannon, "A Mathematical Theory of Communication,"
Bell System Technical J., vol. 27, pp. 623-656, July 1948.- [29] S. Paris and F. Durand, "A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach,"
Int'l J. Computer Vision, vol. 81, pp. 24-52, 2009.- [30] R. Moddemeijer, "On Estimation of Entropy and Mutual Information of Continuous Distributions,"
Signal Processing, vol. 16, no. 3, pp. 233-246, http://www.cs.rug.nl/~rudy/papers/abstracts RM8902.html, 1989.- [31] J.L. Bentley, "Multi-Dimensional Binary Search Trees Used for Associated Searching,"
Comm. ACM, vol. 18, no. 9, pp. 509-517, 1975.- [32] G. Heineman, G. Pollice, and S. Selkow,
Algorithms in a Nutshell, ch. 9, p. 292. O'Reilly, 2008.- [33] D. Collins, A. Zijdenbos, J. Kollokian, N. Sled, C. Kabani, C. Holmes, and A. Evans, "Design and Construction of a Realistic Digital Brain Phantom,"
IEEE Trans. Medical Imaging, vol. 17, no. 3, pp. 463-468, Mar. 1998.- [34] R.M. Henkelman, "Measurement of Signal Intensities in the Presence of Noise in MR Images,"
Medical Physics, vol. 12, no. 2, pp. 232-233, Mar. 1985.- [35] E.M. Haacke, R.W. Brown, M.R. Thompson, and R. Venkatesan,
Magnetic Resonance Imaging: Physical Principles and Sequence Design. John Wiley and Sons, 1999.- [36] S. Awate and R. Whitaker, "Feature-Preserving MRI Denoising: A Nonparametric Empirical Bayes Approach,"
IEEE Trans. Medical Imaging, vol. 26, no. 9, pp. 1242-1255, Sept. 2007.- [37] J.V. Manjon, J. Carbonell-Caballero, J.J. Lull, G. Garcia-Marti, L. Marti-Bonmati, and M. Robles, "MRI Denoising Using Non-Local Means,"
Medical Image Analysis, vol. 12, pp. 514-523, 2008.- [38] D.K. Jones and P.J. Basser, "Squashing Peanuts and Smashing Pumpkins: How Noise Distorts Diffusion Weighted MR Data,"
Magnetic Resonance in Medicine, vol. 52, pp. 979-993, 2004. |