The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.12 - Dec. (2013 vol.35)
pp: 2941-2955
Manmohan Chandraker , NEC Labs. America, Inc., Cupertino, CA, USA
Jiamin Bai , Electr. Eng. & Comput. Sci. Dept., Univ. of California, Berkeley, Berkeley, CA, USA
Ravi Ramamoorthi , Electr. Eng. & Comput. Sci. Dept., Univ. of California, Berkeley, Berkeley, CA, USA
ABSTRACT
This paper presents a comprehensive theory of photometric surface reconstruction from image derivatives in the presence of a general, unknown isotropic BRDF. We derive precise topological classes up to which the surface may be determined and specify exact priors for a full geometric reconstruction. These results are the culmination of a series of fundamental observations. First, we exploit the linearity of chain rule differentiation to discover photometric invariants that relate image derivatives to the surface geometry, regardless of the form of isotropic BRDF. For the problem of shape-from-shading, we show that a reconstruction may be performed up to isocontours of constant magnitude of the gradient. For the problem of photometric stereo, we show that just two measurements of spatial and temporal image derivatives, from unknown light directions on a circle, suffice to recover surface information from the photometric invariant. Surprisingly, the form of the invariant bears a striking resemblance to optical flow; however, it does not suffer from the aperture problem. This photometric flow is shown to determine the surface up to isocontours of constant magnitude of the surface gradient, as well as isocontours of constant depth. Further, we prove that specification of the surface normal at a single point completely determines the surface depth from these isocontours. In addition, we propose practical algorithms that require additional initial or boundary information, but recover depth from lower order derivatives. Our theoretical results are illustrated with several examples on synthetic and real data.
INDEX TERMS
Light sources, Differential theory, Image reconstruction, Surface reconstruction, Lighting, Photometric measurements,differential theory, Surface reconstruction, general BRDF, photometric invariants
CITATION
Manmohan Chandraker, Jiamin Bai, Ravi Ramamoorthi, "On Differential Photometric Reconstruction for Unknown, Isotropic BRDFs", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 12, pp. 2941-2955, Dec. 2013, doi:10.1109/TPAMI.2012.217
REFERENCES
[1] N. Alldrin and D. Kriegman, "Toward Reconstructing Surfaces with Arbitrary Isotropic Reflectance: A Stratified Photometric Stereo Approach," Proc. IEEE Int'l Conf. Computer Vision, 2007.
[2] N. Alldrin, T. Zickler, and D. Kriegman, "Photometric Stereo with Non-Parametric and Spatially-Varying Reflectance," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[3] S. Barsky and M. Petrou, "The 4-Source Photometric Stereo Method for Three-Dimensional Surfaces in the Presence of Highlights and Shadows," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 10, pp. 1239-1252, Oct. 2003.
[4] M. Chandraker, J. Bai, and R. Ramamoorthi, "A Theory of Differential Photometric Stereo for Unknown Isotropic BRDFs," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2505-2512, 2011.
[5] J. Clark, "Active Photometric Stereo," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 29-34, 1992.
[6] M.P. do Carmo, Differential Geometry of Curves and Surfaces. Prentice Hall, 1976.
[7] M. Grant and S. Boyd, "CVX: Matlab Software for Disciplined Convex Programming," http://cvxr.comcvx, 2010.
[8] A. Hertzmann and S. Seitz, "Example-Based Photometric Stereo: Shape Reconstruction with General, Varying BRDFs," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 8, pp. 1254-1264, Aug. 2005.
[9] T. Higo, Y. Matsushita, and K. Ikeuchi, "Consensus Photometric Stereo," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1157-1164, 2010.
[10] M. Holroyd, J. Lawrence, G. Humphreys, and T. Zickler, "A Photometric Approach for Estimating Normals and Tangents," Proc. Siggraph Asia, 2008.
[11] B. Horn, Robot Vision. MIT Press, 1986.
[12] K.M. Lee and C.-C.J. Kuo, "Shape from Shading with a Generalized Reflectance Map Model," Computer Vision and Image Understanding, vol. 67, pp. 143-160, 1997.
[13] B. Lucas and T. Kanade, "An Iterative Image Registration Technique with an Application to Stereo Vision," Proc. Image Understanding Workshop, pp. 121-130, 1981.
[14] M. Brooks and B. Horn, "Shape and Source from Shading," Proc. Int'l Joint Conf. Artificial Intelligence, 1985.
[15] E. Prados and O. Faugeras, "Shape from Shading: A Well-Posed Problem?" Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 870-877, 2005.
[16] R. Ramamoorthi, D. Mahajan, and P. Belhumeur, "A First Order Analysis of Lighting, Shading and Shadows," ACM Trans. Graphics, vol. 26, no. 1, article 2, 2007.
[17] I. Sato, T. Okabe, Q. Yu, and Y. Sato, "Shape Reconstruction Based on Similarity in Radiance Changes under Varying Illumination," Proc. IEEE Int'l Conf. Computer Vision, pp. 1-8, 2007.
[18] A. Savitzky and M. Golay, "Smoothing and Differentiation of Data by Simplified Least Squares Procedures," Analytical Chemistry, vol. 36, no. 8, pp. 1627-1639, 1964.
[19] P. Tan, S. Mallick, D. Kriegman, L. Quan, and T. Zickler, "Isotropy, Reciprocity, and the Generalized Bas-Relief Ambiguity," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[20] P. Tan and T. Zickler, "A Projective Framework for Radiometric Image Analysis," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[21] P. Woodham, "Photometric Method for Determining Surface Orientation from Multiple Images," Optical Eng., vol. 19, no. 1, pp. 139-144, 1980.
[22] R. Zhang, P. Tsai, J. Cryer, and M. Shah, "Shape from Shading: A Survey," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 8, pp. 690-706, Aug. 1999.
[23] T. Zickler, P. Belhumeur, and D. Kriegman, "Helmholtz Stereopsis: Exploiting Reciprocity for Surface Reconstruction," Int'l J. Computer Vision, vol. 49, no. 2/3, pp. 1215-1227, 2003.
8 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool