This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
An Investigation of Methods for Determining Depth from Focus
February 1993 (vol. 15 no. 2)
pp. 97-108

The concept of depth from focus involves calculating distances to points in an observed scene by modeling the effect that the camera's focal parameters have on images acquired with a small depth of field. This technique is passive and requires only a single camera. The most difficult segment of calculating depth from focus is deconvolving the defocus operator from the scene and modeling it. Most current methods for determining the defocus operator employ inverse filtering. The authors reveal some fundamental problems with inverse filtering: inaccuracies in finding the frequency domain representation, windowing effects, and border effects. A general, matrix-based method using regularization is presented, which eliminates these problems. The new method is confirmed experimentally, with the results showing an RMS error of 1.3%.

[1] H. C. Andrews and B. R. Hunt,Digital Image Restoration. Englewood Cliffs, NJ: Prentice-Hall, 1977.
[2] M. Bertero, T. A. Poggio, and V. Torre, "Ill-posed problems in early vision,"Proc. IEEE, vol. 76, pp. 869-889, Aug. 1988.
[3] M. Born and E. Wolf,Principles of Optics. New York: Pergammon, 1980, 6th ed.
[4] V. Michael Bove, Jr., "Discrete fourier transform based depth-from-focus," inImage Understanding and Machine Vision, 1989 Tech. Dig. Series, Opt. Soc. Amer. Air Force Office Sci. Res., June 1989, vol. 14, pp. 118-121.
[5] R. N. Bracewell,The Fourier Transform and Its Applications. New York: McGraw-Hill, 1986, 2nd ed.
[6] J. E. Ens, "An investigation of methods for determining depth from focus," Ph.D. thesis, Univ. of British Columbia, July 1990.
[7] D. Gabor, "Theory of communication,"J. Inst. Elect. Eng., vol. 93, no. 429-457, 1946.
[8] B. Girod and S. Scherock, "Depth from defocus of structured light,"Optics Illumination Image Sensing Machine Vision IV, vol. 1194, 1989.
[9] R.C. Gonzalez and P. Wintz,Digital Image Processing, Addison-Wesley, Reading, Mass., 1987.
[10] J. Hadamard,Lectures on Cauchy's Problem in Linear Partial Differential Equations. New York: Dover, 1952.
[11] F. J. Harris, "On the use of windows for harmonic analysis with the discrete fourier transform,"Proc. IEEE, vol. 66, no. 1, pp. 51-83, Jan. 1978.
[12] E. Hecht,Optics. Reading MA:, Addison-Wesley, 1987, 2nd ed.
[13] H. L. F. von Helmholtz,Helmholtz's Treatise on Physiological Optics (translated from the 3rd German ed.)(J. P. C. Southall, Ed.). Rochester, New York: Opt. Soc. Amer., 1924.
[14] H. H. Hopkins, "The frequency response of a defocused optical system,"Proc. Royal Soc. London, A, vol. 231, pp. 91-103, 1955.
[15] B. K. P. Horn, "Focusing," A. I. Memo 160, Mass. Inst. Technol., May 1968.
[16] B. K. P. Horn,Robot Vision. Cambridge, MA: M.I.T. Press, 1986.
[17] T. R. Hsing, "Correction of pixel nonuniformities for solid-state imagers," inProcessing Images Data Opt. Sensors, vol. 292, pp. 218-224, 1981.
[18] F. Lei and H. J. Tiziani, "A comparison of methods to measure the modulation transfer function of aerial survey lens systems from image structures,"Photogram. Eng. Remote Sensing, vol. 54, no. 1, pp. 41-46, Jan. 1988.
[19] A. Pentland, T. Darrell, M. Turk, and W. Huang," A simple, real-time range camera," inIEEE Comput. Soc. Conf. Comput. Vision Patt Recogn., 1989, pp. 256-261.
[20] A. P. Pentland, "Depth of scene from depth of field," inProc. Image Understanding Workshop, Apr. 1982, pp. 253-259.
[21] A. P. Pentland, "A new sense of depth of field," inNinth Int. Joint Conf. AI, Aug. 1985, pp. 988-994.
[22] A. P. Pentland, "A new sense for depth of field,"IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-9, no. 4, pp. 523-531, July 1987.
[23] W. H. Press, B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling,Numerical Recipes. Cambridge, UK: Cambridge University Press, 1987.
[24] A. Rosenfeld and A. Kak,Digital Picture Processing, New York: Academic, 1976.
[25] W. F. Schreiber,Fundamentals of Electronic Imaging Systems (Springer Series in Information Sciences). Berlin: Springer-Verlag, 1986, vol. 15.
[26] M. Subbarao, "Parallel depth recovery by changing camera parameters," inProc. 2nd Int. Conf. Comput. Vision(Tampa, FL), Dec. 1988, pp. 149-155.
[27] M. Subbarao, "Direct recovery of depth-map," Tech. Rep. 87-02, Comput. Vision Graphics Lab., Dept. of Elect. Eng., State Univ. of New York, Stony Brook, Feb. 1987.
[28] M. Subbarao, "Direct recovery of depth-map I: Differential methods," inProc. IEEE Comput. Soc. Workshop Comput. Vision, Dec. 1987, pp. 58-65.
[29] M. Subbarao, "Direct recovery of depth-map II: A new robust approach," Tech. Rep, 87-03, Comput. Vision Graphics Lab., Dept. of Elect. Eng., State Univ. of New York, Stony Brook, Apr. 1987.
[30] M. Subbarao, "Efficient depth recovery through inverse optics," inMachine Vision for Inspection and Measurement(H. Freeman, Ed.). New York: Academic, 1989, pp. 101-126.
[31] M. Subbarao and N. Gurumoorthy, "Depth recovery from blurred edge," inIEEE Int. Conf. Comput. Vision Patt. Recogn.(Ann Arbor, MI), 1988, pp. 498-503.
[32] A. N. Tihonov, "Solution of incorrectly formulated problems and the regularization method,"Soviet Math., vol. 4, pp. 1035-1038, 1963 (translation of Doklady Akademii Nuak SSSR).

Index Terms:
depth from focus; focal parameters; deconvolving; defocus operator; inverse filtering; frequency domain representation; windowing effects; border effects; matrix-based method; RMS error; computer vision; image recognition
Citation:
J. Ens, P. Lawrence, "An Investigation of Methods for Determining Depth from Focus," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, no. 2, pp. 97-108, Feb. 1993, doi:10.1109/34.192482
Usage of this product signifies your acceptance of the Terms of Use.