This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Depth Estimation and Image Restoration Using Defocused Stereo Pairs
November 2004 (vol. 26 no. 11)
pp. 1521-1525
We propose a method for estimating depth from images captured with a real aperture camera by fusing defocus and stereo cues. The idea is to use stereo-based constraints in conjunction with defocusing to obtain improved estimates of depth over those of stereo or defocus alone. The depth map as well as the original image of the scene are modeled as Markov random fields with a smoothness prior, and their estimates are obtained by minimizing a suitable energy function using simulated annealing. The main advantage of the proposed method, despite being computationally less efficient than the standard stereo or DFD method, is simultaneous recovery of depth as well as space-variant restoration of the original focused image of the scene.

[1] B. Julesz, Binocular Depth Perception without Familiarity Cues Science, vol. 145, pp. 356-362, 1964.
[2] A.P. Pentland, A New Sense for Depth of Field, IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, pp. 523-531, 1987.
[3] D. Marr and T. Poggio, Co-Operative Computation of Stereo Disparity Science, vol. 194, pp. 283-287, 1976.
[4] S.T. Barnard and W.B. Thompson, Disparity Analysis of Images IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 2, pp. 333-339, 1980.
[5] D. Scharstein and R. Szeliski, A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms Int'l J. Computer Vision, vol. 47, pp. 7-42, 2002.
[6] M. Subbarao, "Parallel Depth Recovery by Changing Camera Parameters," Proc. Int'l Conf. Computer Vision, pp. 149-155, Dec. 1988.
[7] Y. Xiong and S.A. Shafer, "Depth From Focusing and Defocusing," Proc. Computer Vision and Pattern Recognition, pp. 68-73, 1993.
[8] A.N. Rajagopalan and S. Chaudhuri, Space-Variant Approaches to Recovery of Depth from Defocused Images Computer Vision and Image Understanding, vol. 68, pp. 309-329, 1997.
[9] A.N. Rajagopalan and S. Chaudhuri, Optimal Recovery of Depth from Defocused Images Using an MRF Model Proc. IEEE Int'l Conf. Computer Vision, pp. 1047-1052, 1998.
[10] M. Watanabe and S.K. Nayar, Rational Filters for Passive Depth from Defocus Int'l J. Computer Vision, vol. 27, pp. 203-225, 1998.
[11] Y.Y. Schechner and N. Kiryati, Depth from Defocus vs. Stereo: How Different Really Are They? Int'l J. Computer Vision, vol. 39, pp. 141-162, 2000.
[12] J. Flusser and T. Suk, Degraded Image Analysis: An Invariant Approach IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, pp. 590-603, 1998.
[13] A. Kubota, K. Kodama, and K. Aizawa, Registration and Blur Estimation Methods for Multiple Differently Focused Images Proc. IEEE Int'l Conf. Image Processing, vol. 2, pp. 447-451, 1999.
[14] J. Flusser and B. Zitova, Combined Invariants to Linear Filtering and Rotation Int'l J. Pattern Recognition and Artificial Intelligence, vol. 13, pp. 1123-1136, 1999.
[15] F. Deschenes, P. Fuchs, and D. Zioul, Homotopy-Based Estimation of Depth Cues in Spatial Domain Proc. IEEE Int'l Conf. Pattern Recognition, vol. 3, pp. 627-630, 2002.
[16] Y.P. Tsai, J. Leu, and C.H. Chen, Depth Estimation by Integration of Depth-from-Defocus and Stereo Vision Inst. of Information Science, Taipei, 1998.
[17] J. Subrahmonia, Y.P. Hung, and D.B. Cooper, Model-Based Segmentation and Estimation of 3D Surfaces from Two or More Intensity Images Using Markov Random Fields Proc. IEEE Int'l Conf. Pattern Recognition, pp. 390-397, 1990.
[18] S. Geman and D. Geman, Stochastic Relaxation, Gibbs Distributions and the Bayesian Distribution of Images IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, pp. 721-741, 1984.
[19] D. Rajan and S. Chaudhuri, Simultaneous Estimation of Super-Resolved Scene and depth Map from Low Resolution Observations IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, pp. 1102-1117, 2003.
[20] S. Roy and I. Cox, A Maximum-Flow Formulation of the N-Camera Stereo Correspondence Problem IEEE Proc. Int'l Conf. Computer Vision, pp. 492-499, 1998.

Index Terms:
Defocus, stereo, disparity, Markov random field, blur identification, depth recovery.
Citation:
A.N. Rajagopalan, S. Chaudhuri, Uma Mudenagudi, "Depth Estimation and Image Restoration Using Defocused Stereo Pairs," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 11, pp. 1521-1525, Nov. 2004, doi:10.1109/TPAMI.2004.102
Usage of this product signifies your acceptance of the Terms of Use.