This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
An MRF Model-Based Approach to Simultaneous Recovery of Depth and Restoration from Defocused Images
July 1999 (vol. 21 no. 7)
pp. 577-589

Abstract—Depth from defocus (DFD) problem involves calculating the depth of various points in a scene by modeling the effect that the focal parameters of the camera have on images acquired with a small depth of field. In this paper, we propose a MAP-MRF-based scheme for recovering the depth and the focused image of a scene from two defocused images. The space-variant blur parameter and the focused image of the scene are both modeled as MRFs and their MAP estimates are obtained using simulated annealing. The scheme is amenable to the incorporation of smoothness constraints on the spatial variations of the blur parameter as well as the scene intensity. It also allows for inclusion of line fields to preserve discontinuities. The performance of the proposed scheme is tested on synthetic as well as real data and the estimates of the depth are found to be better than that of the existing window-based DFD technique. The quality of the space-variant restored image of the scene is quite good even under severe space-varying blurring conditions.

[1] E.P. Krotkov,Active Computer Vision by Cooperative Focus and Stereo.New York: Springer-Verlag, 1989.
[2] S.K. Nayar and Y. Nakagawa, "Shape from Focus," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 8, pp. 824-831, Aug. 1994.
[3] A. Pentland, "A New Sense for Depth of Field, IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, no. 4, pp. 523-531, July 1987.
[4] M. Subbarao, "Parallel Depth Recovery by Changing Camera Parameters," Proc. Int'l Conf. Computer Vision, pp. 149-155, Dec. 1988.
[5] R.E. Bryant, D. Beatty, K. Brace, K. Cho, and T. Sheffler, "COSMOS: A Compiled Simulator for MOS Circuits," Proc. Design Automation Conf., pp. 9-16. ACM/IEEE, June 1987.
[6] V.M. Bove, “Entropy-Based Depth from Focus,” J. Optical Soc. Am. A, vol. 10, pp. 561-566, 1993.
[7] J. Enns and P. Lawrence,“An investigation of methods for determining depth from gocus,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 2, pp. 97-108, Feb. 1993.
[8] G. Surya and M. Subbarao, "Depth From Defocus by Changing Camera Aperture: A Spatial Domain Approach," Computer Vision and Pattern Recognition, pp. 61-67, 1993.
[9] A. Pentland, S. Scherock, T. Darrell, and B. Girod, “Simple Range Cameras Based on Focal Error,” J. Optical Soc. Am. A, vol. 11, pp. 2,925-2,934, Nov. 1994.
[10] Y. Xiong and S.A. Shafer, "Depth From Focusing and Defocusing," Proc. Computer Vision and Pattern Recognition, pp. 68-73, 1993.
[11] M. Gokstorp, "Computing Depth from Out-of-Focus Blur Using a Local Frequency Representation," Proc. Int'l Conf. Pattern Recognition, Oct. 1994.
[12] Y. Xiong and S.A. Shafer, "Variable Window Gabor Filters and Their Use in Focus and Correspondence," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 668-671, June 1994.
[13] M. Subbarao and T. Wei, "Focused Image Recovery from Two Defocused Images Recorded with Different Camera Settings," IEEE Trans. Image Processing, vol. 4, pp. 1,613-1,628, 1995.
[14] A.N. Rajagopalan and S. Chaudhuri, “A Block Shift-Variant Blur Model for Recovering Depth from Defocused Images,” Proc. IEEE Conf. Image Processing, pp. 636-639, 1995.
[15] A.N. Rajagopalan and S. Chaudhuri, “Space-Variant Approaches to Recovery of Depth from Defocused Images,” Computer Vision and Image Understanding, vol. 68, no. 3, pp. 309-329, Dec. 1997.
[16] A.N. Rajagopalan and S. Chaudhuri, “Optimum Selection of Camera Parameters for Recovery of Depth from Defocused Images,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 219-224, San Juan, Puerto Rico, June 1997.
[17] A.N. Rajagopalan and S. Chaudhuri, “Performance Analysis of Maximum Likelihood Estimator for Recovery of Depth from Defocused Images and Optimal Selection of Camera Parameters,” Int'l J. Computer Vision, vol. 30, no. 3, pp. 175-190, Dec. 1998.
[18] A.N. Rajagopalan and S. Chaudhuri, “A Variational Approach to Depth from Defocus,” Proc. Intl. Conf., Intelligent Robotic Systems, pp. 45-48, Bangalore, India, 1995.
[19] A.N. Rajagopalan and S. Chaudhuri, “A Variational Approach to Recovering Depth from Defocused Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 10, pp. 1,158-1,165 Oct. 1997.
[20] J. Subrahmonia, Y.P. Hung, and D.B. Cooper, Model-Based Segmentation and Estimation of 3D Surfaces from Two or More Intensity Images Using Markov Random Fields Proc. IEEE Int'l Conf. Pattern Recognition, pp. 390-397, 1990.
[21] D.B. Cooper, J. Subhramonia, Y.P. Hung, and B. Cernuschi-Frias, “The Use of Markov Random Fields in Estimating and Recognizing Objects in 3D Space,” Markov Random Fields: Theory and Applications, R. Chellappa and A. Jain, eds. Academic Press, 1993.
[22] M. Born and E. Wolf, Principles of Optics. London: Pergamon, 1965.
[23] J.W. Goodman, Introduction to Fourier Optics. McGraw-Hill, 1968.
[24] W.F. Schreiber, Fundamentals of Electronic Imaging Systems. Springer-Verlag, 1986.
[25] J.W. Woods, “Two-Dimensional Discrete Markovian Fields,” IEEE Trans. Information Theory, vol. 18, pp. 232-240, 1972.
[26] R.C. Dubes and A.K. Jain, “Random Field Models in Image Analysis,” J. Applied Statistics, vol. 16, no. 2, pp. 131-163, 1989.
[27] J.E. Besag, “Spatial Interaction and the Statistical of Lattice Systems,” J. Royal Statistical Soc., Series B, vol. 36, pp. 192-236, 1974.
[28] S. Geman and D. Geman, “Stochastic Relaxation, Gibbs Distributions and the Bayesian Distribution of Images” IEEE Trans. Pattern Analysis and Machine Intelligence vol. 6, pp. 721-741, Nov. 1984.
[29] S.Z. Li, Markov Random Field Modeling in Computer Vision. New York: Springer-Verlag, 1995.
[30] H. Derin and H. Elliott, "Modelling and Segmentation of Noisy and Textured Images Using Gibbs Random Fields," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, no. 1, pp. 39-55, Jan. 1987.
[31] B. Chalmond, “Image Restoration Using an Estimated Markov Model,” Signal Processing, vol. 15, pp. 115-129, 1988.
[32] M. Gurelli and L. Onural, "On a Parameter Estimation Method for Gibbs-Markov Random Fields," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 4, Apr. 1994.
[33] P.K. Nanda, “MRF Model Learning and Its Applications to Image Restoration and Segmentation,” PhD dissertation, Dept. of Electrical Eng., Indian Inst. of Technology, Bombay, India.
[34] D.C. Ghiglia, “Space-Invariant Deblurring Given$N$Independently Blurred Images of a Common Object,” J. Optical Soc. Am. A., vol. 1, no. 4, pp. 398-402, Apr. 1984.
[35] A.N. Rajagopalan and S. Chaudhuri, “Maximum Likelihood Estimation of Blur from Multiple Observations,” Proc. IEEE Conf. and Acoustics, Speech, and Signal Processing, pp. 2,577-2,580, Munich, Germany, Apr. 1997.
[36] A. N. Rajagopalan and S. Chaudhuri, “A Recursive Algorithm for Maximum Likelihood-Based Identification of Blur from Multiple Observations,” IEEE Trans. Image Processing, vol. 7, pp. 1,075-1,079, July 1998.
[37] S. Kirkpatrick, G.D. Gellatt, and M.P. Vecchi, “Optimization by Simulated Annealing,” Science, vol. 220, pp. 671-680, 1983.

Index Terms:
Depth from defocus, space-variant blur, space-variant image restoration, Markov random field, smoothness constraint, line fields, Gibbs distribution, maximum a posteriori, simulated annealing.
Citation:
A.n. Rajagopalan, S. Chaudhuri, "An MRF Model-Based Approach to Simultaneous Recovery of Depth and Restoration from Defocused Images," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21, no. 7, pp. 577-589, July 1999, doi:10.1109/34.777369
Usage of this product signifies your acceptance of the Terms of Use.