This Article 
 Bibliographic References 
 Add to: 
Unsupervised, Information-Theoretic, Adaptive Image Filtering for Image Restoration
March 2006 (vol. 28 no. 3)
pp. 364-376
Ross T. Whitaker, IEEE Computer Society
Image restoration is an important and widely studied problem in computer vision and image processing. Various image filtering strategies have been effective, but invariably make strong assumptions about the properties of the signal and/or degradation. Hence, these methods lack the generality to be easily applied to new applications or diverse image collections. This paper describes a novel unsupervised, information-theoretic, adaptive filter (UINTA) that improves the predictability of pixel intensities from their neighborhoods by decreasing their joint entropy. In this way, UINTA automatically discovers the statistical properties of the signal and can thereby restore a wide spectrum of images. The paper describes the formulation to minimize the joint entropy measure and presents several important practical considerations in estimating neighborhood statistics. It presents a series of results on both real and synthetic data along with comparisons with current state-of-the-art techniques, including novel applications to medical image processing.

[1] NLM Insight Segmentation and Registration Toolkit, http:/, 2005.
[2] D. Adalsteinsson and J. Sethian, “A Fast Level Set Method for Propagating Interfaces,” J. Computer Physics, vol. 118, no. 2, pp. 269-277, 1995.
[3] S.P. Awate and R.T. Whitaker, “Higher-Order Image Statistics for Unsupervised, Information-Theoretic, Adaptive, Image Filtering,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 44-51, 2005.
[4] S.P. Awate and R.T. Whitaker, “Nonparametric Neighborhood Statistics for MRI Denoising,” Proc. Int'l Conf. Information Processing in Medical Imaging, 2005.
[5] D. Barash and D. Comaniciu, “A Common Framework for Nonlinear Diffusion, Adaptive Smoothing, Bilateral Filtering and Mean Shift,” Image Vision Computing, vol. 22, no. 1, pp. 73-81, 2004.
[6] T. Chan, J. Shen, and L. Vese, “Variational PDE Models in Image Processing,” Notice of Am. Math. Soc., vol. 50, pp. 14-26, Jan. 2003.
[7] Y. Cheng, “Mean Shift, Mode Seeking, and Clustering,” IEEE Trans. Pattern Analysis Machine Intelligence, vol. 17, no. 8, pp. 790-799, Aug. 1995.
[8] D.L. Collins, A.P. Zijdenbos, V. Kollokian, J.G. Sled, N.J. Kabani, C.J. Holmes, and A.C. Evans, “Design and Construction of a Realistic Digital Brain Phantom,” IEEE Trans. Medical Imaging, vol. 17, no. 3, pp. 463-468, 1998.
[9] D. Comaniciu and P. Meer, “Mean Shift: A Robust Approach toward Feature Space Analysis,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, May 2002.
[10] T.M. Cover and J.A. Thomas, Elements of Information Theory. Wiley, 1991.
[11] V. de Silva and G. Carlsson, “Topological Estimation Using Witness Complexes,” Proc. Symp. Point-Based Graphics, 2004.
[12] J. DeBonet and P. Viola, “A Nonparametric Multiscale Statistical Model for Natural Images,” Proc. Conf. Advances in Neural Infomation Processing Systems, pp. 773-779, 1998.
[13] E. Dougherty, Random Processes for Image and Signal Processing. Wiley, 1998.
[14] R. Duda, P. Hart, and D. Stork, Pattern Classification. Wiley, 2001.
[15] A. Efros and T. Leung, “Texture Synthesis by Nonparametric Sampling,” Proc. Int'l Conf. Computer Vision, p. 1033, 1999.
[16] M. Everett and J. Mancuso, Reptiles. Stanford Univ., 2001.
[17] K. Fukunaga and L. Hostetler, “The Estimation of the Gradient of a Density Function, with Applications in Pattern Recognition,” IEEE Trans. Infomation Theory, vol. 21, no. 1, pp. 32-40, 1975.
[18] S. Geman and D. Geman, “Stochastic Relaxation, Gibbs Distributions and the Bayesian Restoration of Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, pp. 721-741, 1984.
[19] Unsupervised Adaptive Filtering, S. Haykin, ed. Wiley, 2000.
[20] J. Huang and D. Mumford, “Statistics of Natural Images and Models,” Proc. Int'l Conf. Computer Vision, pp. 541-547, 1999.
[21] A. Hyvarinen, P. Hoyer, and E. Oja, “Sparse Code Shrinkage: Denoising of Nongaussian Data by Maximum Likelihood Estimation,” Neural Computation, vol. 11, no. 7, pp. 1739-1768, 1999.
[22] A. Lee, K. Pedersen, and D. Mumford, “The Nonlinear Statistics of High-Contrast Patches in Natural Images,” Int'l J. Computer Vision, vol. 54, nos. 1-3, pp. 83-103, 2003.
[23] J. Miller and C. Stewart, “Muse: Robust Surface Fitting Using Unbiased Scale Estimates,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 300-306, June 1996.
[24] D. Mumford and J. Shah, “Optimal Approximations by Piecewise Smooth Functions and Associated Variational Problems,” Computation of Pure and Applied Math., vol. 42, pp. 577-685, 1989.
[25] K.N. Nordstrom, “Biased Anisotropic Diffusion: A Unified Regularization and Diffusion Approach to Edge Detection,” Image Vision Computing, vol. 8, no. 4, pp. 318-327, 1990.
[26] S. Osher and R. Fedkiw, Level Set Methods and Dynamic Implicit Surfaces. Springer, 2003.
[27] P. Perona and J. Malik, “Scale-Space and Edge Detection Using Anisotropic Diffusion,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 7, pp. 629-639, July 1990.
[28] A. Pizurica, W. Philips, I. Lemahieu, and M. Acheroy, “A Joint Inter and Intrascale Statistical Model for Bayesian Wavelet Based Image Denoising,” IEEE Trans. Image Processing, vol. 11, pp. 545-557, 2002.
[29] K. Popat and R. Picard, “Cluster Based Probability Model and Its Application to Image and Texture Processing,” IEEE Trans. Image Processing, vol. 6, no. 2, pp. 268-284, 1997.
[30] J. Portilla, “Full Blind Denoising through Noise Covariance Estimation Using Gaussian Scale Mixtures in the Wavelet Domain,” Proc. IEEE Int'l Conf. Image Processing, pp. 1217-1220, Oct. 2004.
[31] J. Portilla, V. Strela, M. Wainwright, and E. Simoncelli, “Image Denoising Using Scale Mixtures of Gaussians in the Wavelet Domain,” IEEE Trans. Image Processing, vol. 12, no. 11, pp. 1338-1351, 2003.
[32] Geometry-Driven Diffusion in Computer Vision, B.M. Romeny, ed. Kluwer Academic, 1994.
[33] L. Rudin, S. Osher, and E. Fatemi, “Nonlinear Total Variation Based Noise Removal Algorithms,” Physica D, vol. 60, pp. 259-268, 1992.
[34] D.W. Scott, Multivariate Density Estimation. Wiley, 1992.
[35] L. Sendur and I. Selesnick, “Bivariate Shrinkage Functions for Wavelet-Based Denoising Exploiting Interscale Dependency,” IEEE Trans. Signal Processing, vol. 50, pp. 2744-2756, 2002.
[36] J. Sethian, Level Set Methods and Fast Marching Methods. Cambridge Univ. Press, 1999.
[37] C. Shannon, “A Mathematical Theory of Communication,” Bell System Technical J., vol. 27, pp. 379-423, July 1948.
[38] B. Silverman, Density Estimation for Statistics and Data Analysis. Chapman and Hall, 1986.
[39] W. Snyder, Y. Han, G. Bilbro, R. Whitaker, and S. Pizer, “Image Relaxation: Restoration and Feature Extraction,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 6, pp. 620-624, June 1995.
[40] J. Starck, E. Candes, and D. Donoho, “The Curvelet Transform for Image Denoising,” IEEE Trans. Image Processing, vol. 11, no. 6, 2000.
[41] T. Tasdizen, R. Whitaker, P. Burchard, and S. Osher, “Geometric Surface Processing via Normal Maps,” ACM Trans. Graphics, 2003.
[42] C. Tomasi and R. Manduchi, “Bilateral Filtering for Gray and Color Images,” Proc. Int'l Conf. Computer Vision, p. 839, 1998.
[43] L.A. Vese and S.J. Osher, “Modeling Textures with Total Variation Minimization and Oscillating Patterns in Image Processing,” J. Scientific Computing, vol. 19, pp. 553-572, 2003.
[44] P. Viola and W. Wells, “Alignment by Maximization of Mutual Information,” Proc. Int'l Conf. Computer Vision, pp. 16-23, 1995.
[45] L. Wei and M. Levoy, “Order-Independent Texture Synthesis,” Technical Report TR-2002-01, Computer Science Dept., Stanford Univ., 2002.
[46] J. Weickert, Anisotropic Diffusion in Image Processing. Teubner-Verlag, 1998.
[47] J. Weickert, “Coherence-Enhancing Diffusion Filtering,” Int'l J. Computer Vision, vol. 31, pp. 111-127, 1999.
[48] T. Weissman, E. Ordentlich, G. Seroussi, S. Verdu, and M. Weinberger, “Universal Discrete Denoising: Known Channel,” HP Labs Technical Report HPL-2003-29, 2003.

Index Terms:
Index Terms- Filtering, restoration, nonparametric statistics, information theory.
Suyash P. Awate, Ross T. Whitaker, "Unsupervised, Information-Theoretic, Adaptive Image Filtering for Image Restoration," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 3, pp. 364-376, March 2006, doi:10.1109/TPAMI.2006.64
Usage of this product signifies your acceptance of the Terms of Use.