This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Maximum Likelihood Estimation of Depth Maps Using Photometric Stereo
July 2012 (vol. 34 no. 7)
pp. 1368-1380
Adam P. Harrison, University of Alberta, Edmonton
Dileepan Joseph, University of Alberta, Edmonton
Photometric stereo and depth-map estimation provide a way to construct a depth map from images of an object under one viewpoint but with varying illumination directions. While estimating surface normals using the Lambertian model of reflectance is well established, depth-map estimation is an ongoing field of research and dealing with image noise is an active topic. Using the zero-mean Gaussian model of image noise, this paper introduces a method for maximum likelihood depth-map estimation that accounts for the propagation of noise through all steps of the estimation process. Solving for maximum likelihood depth-map estimates involves an independent sequence of nonlinear regression estimates, one for each pixel, followed by a single large and sparse linear regression estimate. The linear system employs anisotropic weights, which arise naturally and differ in value to related work. The new depth-map estimation method remains efficient and fast, making it practical for realistic image sizes. Experiments using synthetic images demonstrate the method's ability to robustly estimate depth maps under the noise model. Practical benefits of the method on challenging imaging scenarios are illustrated by experiments using the Extended Yale Face Database B and an extensive data set of 500 reflected light microscopy image sequences.

[1] R.J. Woodham, "Photometric Method for Determining Surface Orientation from Multiple Images," Optical Eng., vol. 19, no. 1, pp. 139-144, 1980.
[2] B.K.P. Horn and M.J. Brooks, "The Variational Approach to Shape from Shading," Computer Vision, Graphics, and Image Processing, vol. 33, no. 2, pp. 174-208, Feb. 1986.
[3] R.T. Frankot and R. Chellappa, "A Method for Enforcing Integrability in Shape from Shading Algorithms," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, no. 4, pp. 439-451, July 1988.
[4] T. Simchony, R. Chellappa, and M. Shao, "Direct Analytical Methods for Solving Poisson Equations in Computer Vision Problems," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 5, pp. 435-446, May 1990.
[5] L. Noakes and R. Kozera, "Nonlinearities and Noise Reduction in 3-Source Photometric Stereo," J. Math. Imaging Vision, vol. 18, no. 2, pp. 119-127, 2003.
[6] L. Noakes and R. Kozera, "Denoising Images: Non-Linear Leap-Frog for Shape and Light-Source Recovery," Proc. Geometry, Morphology, and Computational Imaging: Int'l Workshop Theoretical Foundations of Computer Vision, pp. 143-162, 2003.
[7] B. Karaçali and W. Snyder, "Noise Reduction in Surface Reconstruction from a Given Gradient Field," Int'l J. Computer Vision, vol. 60, no. 1, pp. 25-44, 2004.
[8] M. Harker and P. O'Leary, "Least Squares Surface Reconstruction from Measured Gradient Fields," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-7, June 2008.
[9] P. Kovesi, "Shapelets Correlated with Surface Normals Produce Surfaces," Proc. 10th IEEE Int'l Conf. Computer Vision, vol. 2, pp. 994-1001, Oct. 2005.
[10] A. Agrawal, R. Chellappa, and R. Raskar, "An Algebraic Approach to Surface Reconstruction from Gradient Fields," Proc. 10th IEEE Int'l Conf. Computer Vision, vol. 1, pp. 174-181, 2005.
[11] A.K. Agrawal, R. Raskar, and R. Chellappa, "What Is the Range of Surface Reconstructions from a Gradient Field?" Proc. European Conf. Computer Vision, pp. 578-591, 2006.
[12] T. Kuparinen and V. Kyrki, "Optimal Reconstruction of Approximate Planar Surfaces Using Photometric Stereo," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 12, pp. 2282-2289, Dec. 2009.
[13] H.-S. Ng, T.-P. Wu, and C.-K. Tang, "Surface-from-Gradients without Discrete Integrability Enforcement: A Gaussian Kernel Approach," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 11, pp. 2085-2099, Nov. 2010.
[14] T. Cameron, R. Kozera, and A. Datta, "A Parallel Leap-Frog Algorithm for 3-Source Photometric Stereo," Proc. Int'l Conf. Computer Vision and Graphics, pp. 95-102, 2006.
[15] R. Ramamoorthi, "Analytic PCA Construction for Theoretical Analysis of Lighting Variability in Images of a Lambertian Object," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 10, pp. 1322-1333, Oct. 2002.
[16] R.C. Gonzalez and R.E. Woods, Digital Image Processing, third ed. Pearson Prentice Hall, 2008.
[17] C. Boncelet, "Image Noise Models," The Essential Guide to Image Processing, second edition ed., A. Bovik, ed. Academic Press, pp. 143-167, 2009.
[18] G. Healey and R. Kondepudy, "Radiometric CCD Camera Calibration and Noise Estimation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 3, pp. 267-276, Mar. 1994.
[19] G.A. Seber and C.J. Wild, Nonlinear Regression. John Wiley & Sons, Inc., 1989.
[20] G.A. Seber and C.J. Wild, Linear Regression Analysis, second ed. John Wiley & Sons, Inc., 2003.
[21] B.K. Horn, Robot Vision. McGraw-Hill Higher Education, 1986.
[22] D.A. Ratkowsky, Nonlinear Regression Modeling. Marcel Dekker, Inc., 1983.
[23] S.L. Meyer, Data Analysis for Scientists and Engineers. John Wiley & Sons, Inc., 1975.
[24] B.K.P. Horn, "Height and Gradient from Shading," Int'l J. Computer Vision, vol. 5, pp. 37-75, Sept. 1990.
[25] C. Paige, "Computer Solution and Perturbation Analysis of Generalized Linear Least Squares Problems," Math. Computation, vol. 33, no. 145, pp. 171-183, 1979.
[26] J.-D. Durou, M. Falcone, and M. Sagona, "Numerical Methods for Shape-from-Shading: A New Survey with Benchmarks," Computer Vision and Image Understanding, vol. 109, no. 1, pp. 22-43, 2008.
[27] A. Georghiades, P. Belhumeur, and D. Kriegman, "From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 643-660, June 2001.
[28] A.P. Harrison, C. Wong, and D. Joseph, "Virtual Reflected-Light Microscopy," J. Microscopy, vol. 244, pp. 293-304, 2011.
[29] P. Swaby, "VIDES: An Expert System for Visually Identifying Microfossils," IEEE Expert, vol. 7, no. 2, pp. 36-42, Apr. 1992.
[30] J. Kennett and L. Stott, "Abrupt Deep-Sea Warming, Palaeoceanographic Changes and Benthic Extinctions at the End of the Palaeocene," Nature, vol. 353, pp. 225-229, Sept. 1991.
[31] T.A. Davis, Direct Methods for Sparse Linear Systems (Fundamentals of Algorithms 2). SIAM, 2006.

Index Terms:
Photometric stereo, depth map, maximum likelihood estimation, nonlinear regression, finite difference methods.
Citation:
Adam P. Harrison, Dileepan Joseph, "Maximum Likelihood Estimation of Depth Maps Using Photometric Stereo," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, no. 7, pp. 1368-1380, July 2012, doi:10.1109/TPAMI.2011.249
Usage of this product signifies your acceptance of the Terms of Use.