The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.03 - March (2008 vol.30)
pp: 518-531
ABSTRACT
Defocus can be modeled as a diffusion process and represented mathematically using the heat equation, where image blur corresponds to the diffusion of heat. This analogy can be extended to non-planar scenes by allowing a space-varying diffusion coefficient. The inverse problem of reconstructing 3-D structure from blurred images corresponds to an “inverse diffusion” that is notoriously ill-posed. We show how to bypass this problem by using the notion of relative blur. Given two images, within each neighborhood, the amount of diffusion necessary to transform the sharper image into the blurrier one depends on the depth of the scene. This can be used to devise a global algorithm to estimate the depth profile of the scene without recovering the deblurred image, using only forward diffusion.
INDEX TERMS
Shape, Reconstruction, Depth cues, Gradient methods, Iterative methods, Partial differential equations, Inverse problems, Sharpening and Deblurring
CITATION
Paolo Favaro, Stefano Soatto, Martin Burger, Stanley J. Osher, "Shape from Defocus via Diffusion", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.30, no. 3, pp. 518-531, March 2008, doi:10.1109/TPAMI.2007.1175
REFERENCES
[1] P. Favaro, A. Mennucci, and S. Soatto, “Observing Shape from Defocused Images,” Int'l J. Computer Vision, vol. 52, no. 1, pp. 25-43, 2003.
[2] J. Ens and P. Lawrence, “An Investigation of Methods for Determining Depth from Focus,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, pp. 97-108, 1993.
[3] N. Nair and C. Stewart, “Robust Focus Ranging,” Proc. IEEE Computer Vision and Pattern Recognition, pp. 309-314, 1992.
[4] P. Favaro, S. Soatto, L. Vese, and S. Osher, “3-D Shape from Anisotropic Diffusion,” Proc. IEEE Computer Vision and Pattern Recognition, vol. I, pp. 179-186, 2003.
[5] D. Luenberger, Optimization by Vector Space Methods. Wiley, 1968.
[6] P. Favaro and S. Soatto, 3-D Shape Reconstruction and Image Restoration: Exploiting Defocus and Motion-Blur. Springer, 2006.
[7] S. Chaudhuri and A. Rajagopalan, Depth from Defocus: A Real Aperture Imaging Approach. Springer, 1999.
[8] A. Rajagopalan and S. Chaudhuri, “Optimal Selection of Camera Parameters for Recovery of Depth from Defocused Images,” Proc. IEEE Computer Vision and Pattern Recognition, pp. 219-224, 1997.
[9] A. Rajagopalan and S. Chaudhuri, “Optimal Recovery of Depth from Defocused Images Using an MRF Model,” Proc. IEEE Int'l Conf. Computer Vision, pp. 1047-1052, 1998.
[10] P. Favaro, A. Mennucci, and S. Soatto, “Observing Shape from Defocused Images,” Int'l J. Computer Vision, vol. 52, no. 1, pp. 25-43, 2003.
[11] P. Favaro and S. Soatto, “Learning Shape from Defocus,” Proc. European Conf. Computer Vision, vol. 2, pp. 735-745, 2002.
[12] P. Favaro and S. Soatto, “Shape and Radiance Estimation from the Information Divergence of Blurred Images,” Proc. IEEE Computer Vision and Pattern Recognition, pp. 755-768, 2000.
[13] S. Nayar and Y. Nakagawa, “Shape from Focus: An Effective Approach for Rough Surfaces,” Proc. IEEE Int'l Conf. Robotics and Automation, pp. 218-225, 1990.
[14] M. Noguchi and S. Nayar, “Microscopic Shape from Focus Using Active Illumination,” Proc. Int'l Conf. Pattern Recognition, pp. 147-152, 1994.
[15] A. Pentland, “A New Sense for Depth of Field,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, pp. 523-531, 1987.
[16] A. Pentland, S. Scherock, T. Darrell, and B. Girod, “Simple Range Cameras Based on Focal Error,” J. Optical Soc. Am. A, vol. 11, no. 11, pp. 2925-2934, 1994.
[17] S. Soatto and P. Favaro, “A Geometric Approach to Blind Deconvolution with Application to Shape from Defocus,” Proc. IEEE Computer Vision and Pattern Recognition, vol. 2, pp. 10-17, 2000.
[18] M. Watanabe and S. Nayar, “Minimal Operator Set for Passive Depth from Defocus,” Proc. IEEE Computer Vision and Pattern Recognition, pp. 431-438, 1996.
[19] A. Rajagopalan, S. Chaudhuri, and U. Mudenagudi, “Depth Estimation and Image Restoration Using Defocused Stereo Pairs,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 11, pp. 1521-1525, Nov. 2004.
[20] M. Bertero and P. Boccacci, Introduction to Inverse Problems in Imaging. Inst. of Physics Publications, 1998.
[21] M. Gokstorp, “Computing Depth from Out-of-Focus Blur Using a Local Frequency Representation,” Proc. Int'l Conf. Pattern Recognition, pp. 153-158, 1994.
[22] Y. Schechner and N. Kiryati, “The Optimal Axial Interval in Estimating Depth from Defocus,” Proc. Int'l Conf. Computer Vision, pp. 843-848, 1993.
[23] Y. Xiong and S. Shafer, “Moment Filters for High Precision Computation of Focus and Stereo,” Proc. Int'l Conf. Intelligent Robots and Systems, pp. 108-113, 1995.
[24] N. Asada, H. Fujiwara, and T. Matsuyama, “Edge and Depth from Focus,” Int'l J. Computer Vision, vol. 26, no. 2, pp. 153-163, 1998.
[25] J. Marshall, C. Burbeck, and D. Ariely, “Occlusion Edge Blur: A Cue to Relative Visual Depth,” J. Optical Soc. Am. A, vol. 13, pp.681-688, 1996.
[26] M. Subbarao and N. Gurumoorthy, “Depth Recovery from Blurred Edges,” Proc. IEEE Computer Vision and Pattern Recognition, pp. 498-503, 1988.
[27] G. Schneider, B. Heit, J. Honig, and J. Bremont, “Monocular Depth Perception by Evaluation of the Blur in Defocused Images,” Proc. IEEE Int'l Conf. Image Processing, vol. 2, pp. 116-119, 1994.
[28] M. Subbarao and G. Surya, “Depth from Defocus: A Spatial Domain Approach,” Int'l J. Computer Vision, vol. 13, pp. 271-294, 1994.
[29] B. Girod and S. Scherock, “Depth from Focus of Structured Light,” Proc. SPIE: Optics, Illumination, and Image Sensing for Machine Vision, vol. 1194, pp. 209-215, 1989.
[30] S. Nayar, M. Watanabe, and M. Noguchi, “Real-Time Focus Range Sensor,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 12, pp. 1186-1198, Dec. 1996.
[31] M. Watanabe and S. Nayar, “Rational Filters for Passive Depth from Defocus,” Proc. Int'l J. Computer Vision, vol. 27, no. 3, 1998.
[32] Y. Xiong and S. Shafer, “Depth from Focusing and Defocusing,” Proc. IEEE Computer Vision and Pattern Recognition, pp. 68-73, 1993.
[33] D. Ziou and F. Deschenes, “Depth from Defocus Estimation in Spatial Domain,” Computer Vision and Image Understanding, vol. 81, no. 2, pp. 143-165, 2001.
[34] J. Koenderink, “The Structure of Images,” Biological Cybernetics, vol. 50, pp. 363-370, 1984.
[35] B. Fischl and E. Schwartz, “Learning an Integral Equation Approximation to Nonlinear Anisotropic Diffusion in Image Processing,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 4, pp. 342-352, Apr. 1997.
[36] S. Osher and S. Sethian, “Fronts Propagating with Curvature-Dependent Speed: Algorithms Based on Hamilton-Jacobi Formulation,” J. Computational Physics, vol. 79, pp. 12-49, 1998.
[37] M. Black, G. Sapiro, D. Marimont, and D. Heeger, “Robust Anisotropic Diffusion,” IEEE Trans. Image Processing, vol. 7, no. 3, pp. 421-432, 1998.
[38] P. Perona and J. Malik, “Scale Space and Edge Detection Using Anisotropic Diffusion,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 7, pp. 629-639, July 1990.
[39] J. Weickert, Anisotropic Diffusion in Image Processing. B.G.Teubner Stuttgart, 1998.
[40] D. Forsyth and J. Ponce, Computer Vision: A Modern Approach. Prentice Hall, 2002.
[41] M. Subbarao, “Parallel Depth Recovery by Changing Camera Parameters,” Proc. IEEE Int'l Conf. Computer Vision, pp. 149-155, 1988.
[42] G. Gilardi, Analisi Due. McGraw Hill, 1992.
[43] D. Tschumperle and R. Deriche, “Vector-Valued Image Regularization with PDE's: A Common Framework for Different Applications,” Proc. IEEE Computer Vision and Pattern Recognition, pp. 651-656, 2003.
[44] H. Hopkins, “The Frequency Response of a Defocused Optical System,” Proc. Royal Soc. London Series A, vol. 231, pp. 91-103, 1955.
[45] R. Lagnado and S. Osher, “A Technique for Calibrating Derivative Security Pricing Models: Numerical Solution of an Inverse Problem,” J. Computational Finance, vol. 1, no. 1, pp. 13-26, 1997.
[46] G. Aubert and P. Kornprobst, “Mathematical Problems in Image Processing: Partial Differential Equations and the Calculus of Variations,” Applied Math. Sciences. Springer, 2001.
[47] L. Ambrosio, N. Gigli, and G. Savare, Gradient Flows in Metric Spaces and in the Space of Probability Measures. Birkhaeuser, 2005.
[48] E. Zeidler, Nonlinear Functional Analysis and Its Applications. Part 1: Fixed-Point Theorems. Springer, 1998.
[49] H. Amann, Linear and Quasilinear Parabolic Problems, Volume I: Abstract Linear Theory. Birkhaeuser, 1995.
[50] M. Protter and H. Weinberger, Maximum Principles in Differential Equations. Prentice Hall, 1967.
25 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool