| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Example-Based Photometric Stereo: Shape Reconstruction with General, Varying BRDFs
August 2005 (vol. 27 no. 8)
pp. 1254-1264
This paper presents a technique for computing the geometry of objects with general reflectance properties from images. For surfaces with varying material properties, a full segmentation into different material types is also computed. It is assumed that the camera viewpoint is fixed, but the illumination varies over the input sequence. It is also assumed that one or more example objects with similar materials and known geometry are imaged under the same illumination conditions. Unlike most previous work in shape reconstruction, this technique can handle objects with arbitrary and spatially-varying BRDFs. Furthermore, the approach works for arbitrary distant and unknown lighting environments. Finally, almost no calibration is needed, making the approach exceptionally simple to apply.
[1] 1254 S. Arya, D.M. Mount, N.S. Netanyahu, R. Silverman, and A.Y. Wu, “An Optimal Algorithm for Approximate Nearest Neighbor Searching in Fixed Dimensions,” J. ACM, vol. 45, no. 6, pp. 891-923, 1998.[2] R. Bajcsy, S. Lee, and A. Leonardis, “Color Image Segmentation with Detection of Highlights and Local Illumination Induced by Inter-Reflections,” Proc. Int'l Conf. Pattern Recognition, vol. 1, pp. 785-790, 1990.[3] R. Basri and D. Jacobs, “Photometric Stereo with General, Unknown Lighting,” Proc. Computer Vision and Pattern Recognition Conf., pp. 374-381, 2001.[4] R. Basri and D.W. Jacobs, “Lambertian Reflectance and Linear Subspaces,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 2, pp. 218-233, Feb. 2003.[5] J.S. Beis and D.G. Lowe, “Indexing without Invariants in 3D Object Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 10, pp. 1000-1015, Oct. 1999.[6] W.-C. Chen, J.-Y. Bouguet, M.H. Chu, and R. Grzeszczuk, “Light Field Mapping: Efficient Representation and Hardware Rendering of Surface Light Fields,” Proc. SIGGRAPH, pp. 447-456, 2002.[7] E. Coleman Jr. and R. Jain, “Obtaining 3-Dimensional Shape of Textured and Specular Surfaces Using Four-Source Photometry,” Proc. Int'l Conf. Color in Graphics and Image Processing (CGIP), vol. 18, no. 4, pp. 309-328, Apr. 1982.[8] K.J. Dana, B. van Ginneken, S.K. Nayar, and J.J. Koenderink, “Reflectance and Texture of Real-World Surfaces,” ACM Trans. Graphics, vol. 18, no. 1, pp. 1-34, 1999.[9] P.E. Debevec and J. Malik, “Recovering High Dynamic Range Radiance Maps from Photographs,” Proc. SIGGRAPH '97, pp. 369-378, 1997.[10] C. Fraley and A.E. Raftery, “How Many Clusters? Which Clustering Method? Answers via Model-Based Cluster Analysis,” The Computer J., vol. 41, no. 8, pp. 578-588, 1998.[11] J.H. Friedman, J.L. Bentley, and R.A. Finkel, “An Algorithm for Finding Best Matches in Logarithmic Expected Time,” ACM Trans. Math. Software, vol. 3, no. 3, pp. 209-226, 1977.[12] A.S. Georghiades, “Recovering 3-D Shape and Reflectance from a Small Number of Photographs,” Proc. Eurographics Symp. Rendering: 14th Eurographics Workshop Rendering, pp. 230-240, June 2003.[13] G. Healey, “Segmenting Images Using Normalized Color,” IEEE Trans. Systems, Man, and Cybernetics, vol. 22, no. 1, pp. 64-73, 1992.[14] A. Hertzmann and S.M. Seitz, “Shape and Materials by Example: A Photometric Stereo Approach,” Proc. Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 533-540, June 2003.[15] B.K.P. Horn, Robot Vision. New York: McGraw-Hill, 1986.[16] K. Ikeuchi, “Determining Surface Orientations of Specular Surfaces by Using the Photometric Stereo Method,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 3, no. 6, pp. 661-669, 1981.[17] G.J. Klinker, S.A. Shafer, and T. Kanade, “A Physical Approach to Color Image Understanding,” Int'l J. Computer Vision, vol. 4, no. 1, pp. 7-38, 1990.[18] D.J. Kriegman, T. Zickler, J. Ho, J. Ponce, and P.N. Belhumeur, “Binocular Helmholtz Stereopsis,” Proc. European Conf. Computer Vision, pp. 1411-1417, Oct. 2003.[19] H.P. Lensch, J. Kautz, M. Goesele, W. Heidrich, and H.-P. Seidel, “Image-Based Reconstruction of Spatial Appearance and Geometric Detail,” ACM Trans. Graphics, vol. 22, no. 2, pp. 234-257, Apr. 2003.[20] W. Matusik, H. Pfister, M. Brand, and L. McMillan, “A Data-Driven Reflectance Model,” ACM Trans. Graphics, vol. 22, no. 3, pp. 759-769, July 2003.[21] W. Matusik, H. Pfister, M. Brand, and L. McMillan, “Efficient Isotropic BRDF Measurement,” Proc. Eurographics Symp. Rendering: 14th Eurographics Workshop Rendering, pp. 241-248, June 2003.[22] S.K. Nayar, K. Ikeuchi, and T. Kanade, “Determining Shape and Reflectance of Hybrid Surfaces by Photometric Sampling,” IEEE Trans. Robotics and Automation, vol. 6, no. 4, pp. 418-431, 1990.[23] S.A. Nene and S.K. Nayar, “A Simple Algorithm for Nearest Neighbor Search in High Dimensions,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 9, pp. 989-1003, Sept. 1997.[24] D. Pelleg and A.W. Moore, “X-Means: Extending K-Means with Efficient Estimation of the Number of Clusters,” Proc. Int'l Conf. Machine Learning, pp. 727-734, 2000.[25] R. Ramamoorthi and P. Hanrahan, “Frequency Space Environment Map Rendering,” ACM Trans. Graphics, vol. 21, no. 3, pp. 517-526, July 2002.[26] W.M. Silver, “Determining Shape and Reflectance Using Multiple Images,” Master's thesis, MIT, Cambridge, Mass., 1980.[27] A.R. Smith and J.F. Blinn, “Blue Screen Matting,” Proc. SIGGRAPH '96, pp. 259-268, Aug. 1996.[28] D. Terzopoulos, “The Computation of Visible-Surface Representations,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, no. 4, pp. 417-438, 1988.[29] A. Treuille, A. Hertzmann, and S.M. Seitz, “Example-Based Stereo with General BRDFs,” Proc. European Conf. Computer Vision, pp. 457-469, 2004.[30] P. Tu and P.R.S. Mendonça, “Surface Reconstruction via Helmholtz Reciprocity with a Single Image Pair,” Proc. Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 541-547, June 2003.[31] Physics-Based Vision: Principles and Practice, Shape Recovery, L.B. Wolff, S.A. Shafer, and G.E. Healey, eds., Boston: Jones and Bartlett, 1992.[32] D.N. Wood, D.I. Azuma, W. Aldinger, B. Curless, T. Duchamp, D.H. Salesin, and W. Stuetzle, “Surface Light Fields for 3D Photography,” Proc. SIGGRAPH, pp. 287-296, 2000.[33] R.J. Woodham, “Photometric Method for Determining Surface Orientation from Multiple Images,” Optical Eng., vol. 19, no. 1, pp. 139-144, 1980.[34] R.J. Woodham, “Gradient and Curvature from Photometric Stereo Including Local Confidence Estimation,” J. Optical Soc. Am. A, vol. 11, no. 11, pp. 3050-3068, Nov. 1994.[35] T. Zickler, P.N. Belhumeur, and D.J. Kriegman, “Helmholtz Stereopsis: Exploiting Reciprocity for Surface Reconstruction,” Int'l J. Computer Vision, vol. 49, nos. 2-3, pp. 215-227, 2002.[36] T. Zickler, P.N. Belhumeur, and D.J. Kriegman, “Toward a Stratification of Helmholtz Stereopsis,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 548-555, June 2003.[37] R.J. Woodham, “Reflectance Map Techniques for Analyzing Surface Defects in Metal Castings,” Technical Report AI-TR-457, MIT, Artificial Intelligence Laboratory, Cambridge, Mass., 1978.[38] R. Lu, J.J. Koenderink, and A.M.L. Kappers, “Optical Properties (Bidirectional Reflection Distribution Functions) of Velvet,” Applied Optics-OT, vol. 37, no. 25, pp. 5974-5984, 1998.
Index Terms:
Index Terms- Photometric stereo, shape reconstruction, shape-from-shading, bidirectional reflectance distribution function (BRDF), specular materials, clustering materials.
Citation:
Aaron Hertzmann, Steven M. Seitz, "Example-Based Photometric Stereo: Shape Reconstruction with General, Varying BRDFs," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 8, pp. 1254-1264, Aug. 2005, doi:10.1109/TPAMI.2005.158
