The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.06 - June (2010 vol.32)
pp: 1060-1071
Dan B Goldman , Adobe Systems, Inc., Seattle
Brian Curless , University of Washington, Seattle
Aaron Hertzmann , University of Toronto, Toronto
Steven M. Seitz , University of Washington, Seattle
ABSTRACT
This paper describes a photometric stereo method designed for surfaces with spatially-varying BRDFs, including surfaces with both varying diffuse and specular properties. Our optimization-based method builds on the observation that most objects are composed of a small number of fundamental materials by constraining each pixel to be representable by a combination of at most two such materials. This approach recovers not only the shape but also material BRDFs and weight maps, yielding accurate rerenderings under novel lighting conditions for a wide variety of objects. We demonstrate examples of interactive editing operations made possible by our approach.
INDEX TERMS
Shape/scene analysis, reflectance digitization and image capture.
CITATION
Dan B Goldman, Brian Curless, Aaron Hertzmann, Steven M. Seitz, "Shape and Spatially-Varying BRDFs from Photometric Stereo", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.32, no. 6, pp. 1060-1071, June 2010, doi:10.1109/TPAMI.2009.102
REFERENCES
[1] N. Alldrin, T. Zickler, and D. Kriegman, "Photometric Stereo with Non-Parametric and Spatially-Varying Reflectance," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2008.
[2] R. Bajcsy, S. Lee, and A. Leonardis, "Color Image Segmentation with Detection of Highlights and Local Illumination Induced by Inter-Reflections," Proc. IEEE Int'l Conf. Pattern Recognition, pp. 785-790, 1990.
[3] H. Biermann, I. Martin, F. Bernardini, and D. Zorin, "Cut-and-Paste Editing of Multiresolution Surfaces," ACM Trans. Graphics, vol. 21, no. 3, pp. 312-321, July 2002.
[4] P.E. Debevec and J. Malik, "Recovering High Dynamic Range Radiance Maps from Photographs," Proc. ACM SIGGRAPH '97, pp. 369-378, 1997.
[5] D.A. Forsyth and J. Ponce, Computer Vision: A Modern Approach. Prentice Hall, 2003.
[6] A.S. Georghiades, "Recovering 3-D Shape and Reflectance from a Small Number of Photographs," Proc. Eurographics/SIGGRAPH Workshop Rendering, pp. 230-240, 2003.
[7] G. Healey, "Segmenting Images Using Normalized Color," IEEE Trans. Systems, Man, and Cybernetics, vol. 22, no. 1, pp. 64-73, Jan./Feb. 1992.
[8] A. Hertzmann, C.E. Jacobs, N. Oliver, B. Curless, and D.H. Salesin, "Image Analogies," Proc. ACM SIGGRAPH, pp. 327-340, 2001.
[9] A. Hertzmann and S.M. Seitz, "Example-Based Photometric Stereo: Shape Reconstruction with General, Varying BRDFs," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 8, pp. 1254-1264, Aug. 2005.
[10] H. Jin, S. Soatto, and A.J. Yezzi, "Multi-View Stereo beyond Lambert," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 171-178, 2003.
[11] H. Jin, A.J. Yezzi, and S. Soatto, "Region-Based Segmentation on Evolving Surfaces with Application to 3D Shape and Radiance Estimation," Proc. European Conf. Computer Vision, pp. 114-125, 2004.
[12] G. Klinker, S. Shafer, and T. Kanade, "A Physical Approach to Color Image Understanding," Int'l J. Computer Vision, vol. 4, no. 1, pp. 7-38, 1990.
[13] G.J.W. Larson, "Measuring and Modeling Anisotropic Reflection," Proc. ACM SIGGRAPH, pp. 265-272, 1992.
[14] J. Lawrence, C. DeCoro, S. Rusinkiewicz, A. Ben-Artzi, R. Ramamoorthi, W. Matusik, and H. Pfister, "Inverse Shade Trees for Non-Parametric Material Representation and Editing," ACM Trans. Graphics, vol. 25, no. 3, pp. 735-745, 2006.
[15] H.P.A. Lensch, J. Kautz, M. Goesele, W. Heidrich, and H.-P. Seidel, "Image-Based Reconstruction of Spatial Appearance and Geometric Detail," ACM Trans. Graphics, vol. 22, no. 2, pp. 234-257, 2003.
[16] S.P. Mallick, T.E. Zickler, D.J. Kriegman, and P.N. Belhumeur, "Beyond Lambert: Reconstructing Specular Surfaces Using Color," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 619-626, 2005.
[17] S.R. Marschner, S.H. Westin, E.P.F. Lafortune, K.E. Torrance, and D.P. Greenberg, "Image-Based BRDF Measurement Including Human Skin," Proc. Eurographics/SIGGRAPH Workshop Rendering, pp. 139-152, 1999.
[18] W. Matusik, H. Pfister, M. Brand, and L. McMillan, "A Data-Driven Reflectance Model," ACM Trans. Graphics, vol. 22, no. 3, pp. 759-769, July 2003.
[19] W. Matusik, H. Pfister, M. Brand, and L. McMillan, "Efficient Isotropic BRDF Measurement," Proc. Eurographics/SIGGRAPH Workshop Rendering, pp. 241-248, 2003.
[20] S.K. Nayar, K. Ikeuchi, and T. Kanade, "Determining Shape and Reflectance of Hybrid Surfaces by Photometric Sampling," IEEE Trans. Robotics and Automation, vol. 6, no. 4, pp. 418-431, Aug. 1990.
[21] J.A. Paterson, D. Claus, and A.W. Fitzgibbon, "BRDF and Geometry Capture from Extended Inhomogeneous Samples Using Flash Photography," Computer Graphics Forum, vol. 24, no. 3, pp. 383-391, 2005.
[22] W.H. Press, S.A. Teukolsky, W.T. Vetterling, and B.P. Flannery, Numerical Recipes in C: The Art of Scientific Computing, second ed. Cambridge Univ. Press, 1992.
[23] Y. Sato, M.D. Wheeler, and K. Ikeuchi, "Object Shape and Reflectance Modeling from Observation," Proc. ACM SIGGRAPH '97, pp. 379-387, 1997.
[24] W.M. Silver, "Determining Shape and Reflectance Using Multiple Images," master's thesis, Massachusetts Inst. of Tech nology, 1980.
[25] X. Tong, J. Zhang, L. Liu, X. Wang, B. Guo, and H.-Y. Shum, "Synthesis of Bidirectional Texture Functions on Arbitrary Surfaces," ACM Trans. Graphics, vol. 21, no. 3, pp. 665-672, July 2002.
[26] A. Treuille, A. Hertzmann, and S.M. Seitz, "Example-Based Stereo with General BRDFs," Proc. European Conf. Computer Vision, 2004.
[27] E. Trucco and A. Verri, Introductory Techniques for 3-D Computer Vision. Prentice Hall, 1998.
[28] P. Tu and P.R.S. Mendonça, "Surface Reconstruction via Helmholtz Reciprocity with a Single Image Pair," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 541-547, 2003.
[29] G. Turk, "Texture Synthesis on Surfaces," Proc. ACM SIGGRAPH '01, pp. 347-354, Aug. 2001.
[30] G. Vogiatzis, C. Hernandez, and R. Cipolla, "Reconstruction in the Round Using Photometric Normals and Silhouettes," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 1847-1854, 2006.
[31] L.-Y. Wei and M. Levoy, "Texture Synthesis over Arbitrary Manifold Surfaces," Proc. ACM SIGGRAPH '01, pp. 355-360, Aug. 2001.
[32] R.J. Woodham, "Photometric Method for Determining Surface Orientation from Multiple Images," Optical Eng., vol. 19, no. 1, pp. 139-144, 1980.
[33] T. Yamazaki, "Introduction of EM Algorithm into Color Image Segmentation," Proc. IEEE Int'l Conf. Intelligent Processing Systems, pp. 368-371, 1998.
[34] L. Ying, A. Hertzmann, H. Biermann, and D. Zorin, "Texture and Shape Synthesis on Surfaces," Proc. Rendering Techniques 2001: 12th Eurographics Workshop Rendering, pp. 301-312, June 2001.
[35] T. Yu, N. Xu, and N. Ahuja, "Recovering Shape and Reflectance Model of Non-Lambertian Objects from Multiple Views," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 226-233, 2004.
[36] Y. Yu, P. Debevec, J. Malik, and T. Hawkins, "Inverse Global Illumination: Recovering Reflectance Models of Real Scenes from Photographs," Proc. ACM SIGGRAPH, pp. 215-224, 1999.
[37] R. Zhang, P.-S. Tsai, J. Cryer, and M. Shah, "Shape-from-Shading: A Survey," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 8, pp. 690-706, Aug. 1999.
[38] T. Zickler, P.N. Belhumeur, and D.J. Kriegman, "Helmholtz Stereopsis: Exploiting Reciprocity for Surface Reconstruction," Int'l J. Computer Vision, vol. 49, nos. 2/3, pp. 215-227, 2002.
17 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool