This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Relief Texture from Specularities
March 2006 (vol. 28 no. 3)
pp. 446-457
In vision and graphics, advanced object models require not only 3D shape, but also surface detail. While several scanning devices exist to capture the global shape of an object, few methods concentrate on capturing the fine-scale detail. Fine-scale surface geometry (relief texture), such as surface markings, roughness, and imprints, is essential in highly realistic rendering and accurate prediction. We present a novel approach for measuring the relief texture of specular or partially specular surfaces using a specialized imaging device with a concave parabolic mirror to view multiple angles in a single image. Laser scanning typically fails for specular surfaces because of light scattering, but our method is explicitly designed for specular surfaces. Also, the spatial resolution of the measured geometry is significantly higher than standard methods, so very small surface details are captured. Furthermore, spatially varying reflectance is measured simultaneously, i.e., both texture color and texture shape are retrieved.

[1] R. Basri and D. Jacobs, “Photometric Stereo with General, Unknown Lighting,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001.
[2] F. Bernardini, I. Martin, J. Mittleman, H. Rushmeier, and G. Taubin, “Building a Digital Model of Michelangelo's Florentine Pieta,” IEEE Computer Graphics and Applications, vol. 22, no. 1, pp. 59-67, Jan./Feb. 2002.
[3] F. Bernardini, I. Martin, and H. Rushmeier, “High-Quality Texture Reconstruction from Multiple Scans,” IEEE Trans. Visualization and Computer Graphics, vol. 7, no. 4, pp. 318-332, Oct.-Dec. 2001.
[4] S.E. Chen and L. Williams, “View Interpolation for Image Synthesis,” Proc. ACM SIGGRAPH, pp. 279-288, Aug. 1993.
[5] O.G. Cula and K.J. Dana, “Compact Representation of Bidirectional Texture Functions,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 1041-1067, Dec. 2001.
[6] O.G. Cula and K.J. Dana, “3D Texture Recognition Using Bidirectional Feature Histograms,” Int'l J. Computer Vision, vol. 59, no. 1, Aug. 2004.
[7] K.J. Dana, “BRDF/BTF Measurement Device,” Proc. Int'l Conf. Computer Vision, vol. 2, pp. 460-466, July 2001.
[8] K.J. Dana, B. van Ginneken, S.K. Nayar, and J.J. Koenderink, “Reflectance and Texture of Real World Surfaces,” ACM Trans. Graphics, vol. 18, no. 1, pp. 1-34, Jan. 1999.
[9] K.J. Dana and J. Wang, “Device for Convenient Measurement of Spatially Varying Bidirectional Reflectance,” J. Optical Soc. Am., pp. 1-12, Jan. 2004.
[10] P.E. Debevec, C.J. Taylor, and J. Malik, “Modeling and Rendering Architecture from Photographs: A Hybrid Geometry and Image-Based Approach,” Proc. ACM SIGGRAPH, pp. 11-20, Aug. 1996.
[11] J. Dong and M. Chantler, “Capture and Synthesis of 3D Surface Texture,” Proc. Second Int'l Workshop Texture Analysis and Synthesis, pp. 41-45, June 2002.
[12] A. Gardner, C. Tchou, T. Hawkins, and P. Debevec, “Linear Light Source Reflectometry,” Proc. ACM SIGGRAPH, pp. 749-758, July 2003.
[13] A. Georghiades, “Incorporating the Torrance and Sparrow Model of Reflectance in Uncalibrated Photometric Stereo,” Proc. Int'l Conf. Computer Vision, pp. 816-825, 2003.
[14] S.J. Gortler, R. Grzeszczuk, R. Szeliski, and M.F. Cohen, “The Lumigraph,” Proc. ACM SIGGRAPH, pp. 43-54, 1996.
[15] M.A. Halstead, B.A. Barsky, S.A. Klein, and R.B. Mandell, “Reconstructing Curved Surfaces from Specular Reflection Patterns Using Spline Surface Fitting of Normals,” Proc. 23rd Ann. Conf. Computer Graphics and Interactive Techniques, pp. 335-342, 1996.
[16] T. Hawkins, J. Cohen, and P. Debevec, “A Photometric Approach to Digitizing Cultural Artifacts,” Proc. Second Int'l Symp. Virtual Reality, Archaeology, and Cultural Heritage, pp. 333-342, 2001.
[17] A. Hertzmann and S. Seitz, “Shape and Materials by Example: A Photometric Stereo Approach,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 533-540, 2003.
[18] J.J. Koenderink and A.J. van Doorn, “Illuminance Texture Due to Surface Mesostructure,” J. Optical Soc. Am. A, vol. 13, pp. 452-463, 1996.
[19] J.J. Koenderink, A.J. van Doorn, K.J. Dana, and S.K. Nayar, “Bidirectional Reflection Distribution Function of Thoroughly Pitted Surfaces,” Int'l J. Computer Vision, vol. 31, vol. 2-3, pp. 129-144, 1999.
[20] T. Leung and J. Malik, “Representing and Recognizing the Visual Appearance of Materials Using Three-Dimensional Textons,” Int'l J. Computer Vision, vol. 43, no. 1, pp. 29-44, June 2001.
[21] M. Levoy and P. Hanrahan, “Light Field Rendering,” Proc. ACM SIGGRAPH, pp. 31-42, Aug. 1996.
[22] M. Levoy, K. Pulli, B. Curless, S. Rusinkiewicz, D. Koller, L. Pereira, M. Ginzton, S. Anderson, J. Davis, J. Ginsberg, J. Shade, and D. Fulk, “The Digital Michelangelo Project: 3D Scanning of Large Statues,” Proc. ACM SIGGRAPH, pp. 131-144, 2000.
[23] X. Liu, Y. Yu, and H.Y. Shum, “Synthesizing Bidirectional Texture Functions for Real World Surfaces,” Proc. ACM SIGGRAPH, pp. 97-106, 2001.
[24] W. Matusik, H. Pfister, A. Ngan, P. Beardsley, R. Ziegler, and L. McMillan, “Image-Based 3D Photography Using Opacity Hulls,” Proc. ACM SIGGRAPH, pp. 427-437, 2002.
[25] L. McMillan and G. Bishop, “Plenoptic Modeling: An Image-Based Rendering System,” Proc. ACM SIGGRAPH, pp. 39-46, Aug. 1995.
[26] H. Murase and S.K. Nayar, “Visual Learning and Recognition of 3D Objects from Appearance,” Int'l J. Computer Vision, pp. 5-24, 1995.
[27] S.K. Nayar, A.C. Sanderson, L.E. Weiss, and D.D. Simon, “Specular Surface Inspection Using Structured Highlight and Gaussian Images,” IEEE Trans. Robotics and Automation, vol. 6, no. 2, pp. 208-218, Apr. 1990.
[28] S.C. Pont and J.J. Koenderink, “Bidirectional Texture Contrast Function,” Proc. European Conf. Computer Vision, pp. 808-822, 2002.
[29] H. Rushmeier, F. Bernardini, J. Mittleman, and G. Taubin, “Acquiring Input for Rendering at Appropriate Levels of Detail: Digitizing a Pieta,” Rendering Techniques, pp. 81-92, 1998.
[30] S. Rusinkiewicz, O. Hall-Holt, and M. Levoy, “Real-Time 3D Model Acquisition,” Proc. ACM SIGGRAPH, pp. 438-446, 2002.
[31] H. Saito, K. Omata, and S. Ozawa, “Recovery of Shape and Surface Reflectance of Specular Object from Relative Rotation of Light Source,” Image and Vision Computing, vol. 21, no. 9, pp. 777-787, Sept. 2003.
[32] S. Savarese, M. Chen, and P. Perona, “Recovering Local Shape of a Mirror Surface from Reflection of a Regular Grid,” Proc. European Conf. Computer Vision, pp. 468-481, 2004.
[33] S. Savarese and P. Perona, “Local Analysis for 3D Reconstruction of Specular Surfaces,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 738-745, 2001.
[34] S. Savarese and P. Perona, “Local Analysis for 3D Reconstruction of Specular Surfaces: Part II,” Proc. European Conf. Computer Vision, vol. 2, p. 759, 2002.
[35] S.M. Seitz and C.R. Dyer, “View Morphing,” Proc. ACM SIGGRAPH, pp. 21-30, Aug. 1996.
[36] I. Stamos and P.K. Allen, “3-D Model Construction Using Range and Image Data,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 531-536, June 2000.
[37] M. Varma and A. Zisserman, “Classifying Images of Materials,” Proc. European Conf. Computer Vision, pp. 255-271, 2002.
[38] J. Wang and K.J. Dana, “A Novel Approach for Texture Shape Recovery,” Proc. Int'l Conf. Computer Vision, pp. 1374-1380, Oct. 2003.
[39] J. Wang and K.J. Dana, “Hybrid Textons: Modeling Surfaces with Reflectance and Geometry,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2004.
[40] R.J. Woodham, “Photometric Methods for Determining Surface Orientation from Multiple Images,” Optics Eng., vol. 19, no. 1, pp. 139-144, 1980.
[41] Y.Z. Yu, A. Ferencz, and J. Malik, “Extracting Objects from Range and Radiance Images,” IEEE Trans. Visualization and Computer Graphics, vol. 7, no. 4, pp. 351-364, Oct.-Dec. 2001.
[42] A. Zalesny and L. Van Gool, “Multiview Texture Models,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 615-622, Dec. 2001.
[43] J.Y. Zheng and A. Murata, “Acquiring a Complete 3D Model from Specular Motion under the Illumination of Circular-Shaped Light Sources,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 913-920, Aug. 2000.

Index Terms:
Index Terms- Texture, relief texture, BTF, bidirectional texture function, 3D texture, shape from specularity, curved mirror, reflectance, roughness.
Citation:
Jing Wang, Kristin J. Dana, "Relief Texture from Specularities," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 3, pp. 446-457, March 2006, doi:10.1109/TPAMI.2006.63
Usage of this product signifies your acceptance of the Terms of Use.