This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Smart Nonlinear Diffusion: A Probabilistic Approach
January 2004 (vol. 26 no. 1)
pp. 63-72

Abstract—In this paper, a stochastic interpretation of nonlinear diffusion equations used for image filtering is proposed. This is achieved by relating the problem of evolving/smoothing images to that of tracking the transition probability density functions of an underlying random process. We show that such an interpretation of, e.g., Perona-Malik equation, in turn allows additional insight and sufficient flexibility to further investigate some outstanding problems of nonlinear diffusion techniques. In particular, upon unraveling the limitations as well as the advantages of such an equation, we are able to propose a new approach which is demonstrated to improve performance over existing approaches and, more importantly, to lift the longstanding problem of a stopping criterion for a nonlinear evolution equation with no data term constraint. Substantiating examples in image enhancement and segmentation are provided.

[1] A.P. Witkin, “Scale Space Filtering,” Proc. Int'l Joint Conf. Artificial Intelligence, pp. 1019-1023, 1983.
[2] J.J. Koendrink, “The Structure of Images,” Biological Cybernetics, vol. 50, pp. 363-370, 1987.
[3] A.L. Yuille and T. Poggio, “Scaling Theorems for Zero-Crossings,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 1, pp. 15-25, 1986.
[4] S. Mallat, “A Theory for Multiresolution Signal Decomposition: The Wavelet Representation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 7, pp. 674-693, July 1989.
[5] S. Mallat, A Wavelet Tour of Signal Processing. Boston: Academic Press, 1997.
[6] D.L. Donoho and I.M. Johnstone, “Ideal Spatial Adaptation via Wavelet Shrinkage,” Biometrika, pp. 425-455, 1994.
[7] H. Krim and J.-C. Pesquet, On the Statistics of Best Bases Criteria. Springer-Verlag, pp. 193-207, July 1995.
[8] P. Perona and J. Malik, “A Network for Multiscale Image Segmentation,” Proc. IEEE Int'l Symp. Circuits and Systems, pp. 2565-2568, June 1988.
[9] P. Perona and J. Malik, “Scale-Space and Edge Detection Using Anisotropic Diffusion,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 7, pp. 629-639, July 1990.
[10] B.M. ter Haar Romeney, Geometry Driven Diffusion. Dordecht: Kluwer Academic, 1994.
[11] G. Sapiro and A. Tannenbaum, “Affine Invariant Scale-Space,” Int'l J. Computer Vision, vol. 11, pp. 25-44, 1993.
[12] L. Alvarez, F. Guichard, P.L. Lions, and J.M. Morel, “Axioms and Fundamental Equations in Image Processing,” Archive for Rational Mechanics, vol. 123, pp. 199-257, Sept. 1993.
[13] N. Nordstrom, “Biased Anisotropic Diffusion: A Unified Regularization and Diffusion Approach to Edge Detection,” Image and Vision Computing, vol. 8, pp. 318-327, 1990.
[14] F. Catté, T. Coll, P.L. Lion, and J.M. Morel, “Image Selective Smoothing and Edge Detection by Nonlinear Diffusion,” SIAM J. Numerical Analysis, vol. 29, pp. 182-193, 1992.
[15] L. Alvarez, P.L. Lions, and J.M. Morel, “Image Selective Smoothing and Edge Detection by Nonlinear Diffusion II,” SIAM J. Numerical Analysis, vol. 29, no. 3, pp. 845-866, 1992.
[16] P.J. Huber, “Robust Estimation of a Location Parameter,” Annals of Math. Statistics, vol. 35, pp. 1753-1758, 1964.
[17] M.J. Black, G. Sapiro, D.H. Marimont, and D. Heeger, “Robust Anisotropic Diffusion,” IEEE Trans. Image Processing, vol. 7, no. 3, pp. 421-432, 1998.
[18] A.B. Hamza, H. Krim, and G. Unal, “Unifying Probabilistic and Variational Estimation,” IEEE Signal Processing Magazine, pp. 37-47, Sept. 2002.
[19] T. Besag, “Spatial Interaction and the Statistical Analysis of Lattice Systems (with Discussion),” J. Royal Statistics Soc., Series B, vol. 36, pp. 192-326, 1974.
[20] S. Geman and D. Geman, “Stochastic Relaxation, Gibbs Distributions, and the Baysian Restoration of Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, no. 6, pp. 721-741, June 1984.
[21] S.C. Zhu and D. Mumford, “Prior Learning and Gibbs Reaction-Diffusion,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 11, pp. 1236-1250, Nov. 1997.
[22] M. Miller, U. Grenander, J. O'Sullivan, and D. Snyder, “Automatic Target Recognition Organized via Jump-Diffusion Algorithms,” IEEE Trans. Image Processing, vol. 6, pp. 157-174, 1997.
[23] A. Srivastava, M. Miller, and U. Grenander, “Jump-Diffusion Processes on Matrix Lie Groups for Bayesian Inference,” technical report, 1999.
[24] D. Mumford, Elastica and Computer Vision: In Algebraic Geometry and Its Applications, C. Bajaj ed., pp. 491-506, Springer-Verlag, 1994.
[25] D. Geman and G. Reynolds, “Constrained Restoration and the Recovery of Discontinuities,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 3, pp. 367-383, Mar. 1992.
[26] W. Snyder, Y. Han, G. Bilbro, R. Whitaker, and S. Pizer, “Image Relaxation: Restoration and Feature Extraction,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 6, pp. 620-624, June 1995.
[27] I. Pollak, A.S. Willsky, and H. Krim, “Image Segmentation and Edge Enhancement with Stabilized Inverse Diffusion Equations,” IEEE Trans. Image Processing, vol. 9, pp. 256-266, 2000.
[28] J. Monteil and A. Beghdadi, “A New Interpretation and Improvement of the Nonlinear Anisotropic Diffusion for Image Enhancement,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, pp. 940-946, 1999.
[29] G. Boccignone, M. Ferraro, and T. Caelli, “Generalized Spatio-Chromatic Diffusion,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, pp. 1298-1309, 2002.
[30] L.I. Rudin, S. Osher, and E. Fatemi, “Nonlinear Total Variation Based Noise Removal Algorithms,” Physica D, pp. 259-268, 1992.
[31] A.T. Yu-li You, W. Xu, and M. Kaveh, “Behavioral Analysis of Anisotropic Diffusion in Image Processing,” IEEE Trans. Image Processing, vol. 5, no. 11, pp. 1539-1552, 1996.
[32] B. Oksendal, Stochastic Differential Equations: An Introduction with Applications. Berlin: Springer-Verlag, 1992.
[33] H. Krim and Y. Bao, “A Stochastic Diffusion Approach to Signal Denoising,” Proc. Int'l Conf. Acoustics, Speech and Signal Processing (ICASSP '99), vol. 4, pp. 1773-1776, 1999.
[34] H. Krim and Y. Bao, “Nonlinear Diffusion: A Probabilistic View,” Proc. IEEE Int'l Conf. Image Processing (ICIP), vol. 2, pp. 21-25, 1999.
[35] H.J. Kushner and P.G. Dupuis, Numerical Methods for Stochastic Control Problems in Continuous Time, first ed. Springer-Verlag, 1992.
[36] H. Kunita, “Stochastic Differential Equations and Stochastic Flows of Diffeomorphisms,” Lecture Notes Math., vol. 1097, pp. 143-303, 1978.
[37] H. Kunita, Stochastic Flows and Stochastic Differential Equations. Academic Press, 1976.
[38] R. Durrett, Stochastic Calculus: A Practical Introduction, first ed. CRC Press, 1997.
[39] A. Papoulis, Probability, Random Variables and Stochastic Processes. McGraw-Hill, 1984.
[40] Y. Bao and H. Krim, “Towards Bridging Scale-Space and Multiscale Frame Analyses,” Wavelets in Signal and Image Analysis: From Theory to Practice, Computational Imaging and Vision, A.A. Petrosian and F. Meyer, eds., vol. 19, ch. 6, Kluwer Academic, 2001.

Index Terms:
Nonlinear diffusion, stochastic flow, particle system.
Citation:
Yufang Bao, Hamid Krim, "Smart Nonlinear Diffusion: A Probabilistic Approach," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 1, pp. 63-72, Jan. 2004, doi:10.1109/TPAMI.2004.10011
Usage of this product signifies your acceptance of the Terms of Use.