This Article 
 Bibliographic References 
 Add to: 
The 4-Source Photometric Stereo Technique for Three-Dimensional Surfaces in the Presence of Highlights and Shadows
October 2003 (vol. 25 no. 10)
pp. 1239-1252

Abstract—We present an algorithm for separating the local gradient information and Lambertian color by using 4-source color photometric stereo in the presence of highlights and shadows. We assume that the surface reflectance can be approximated by the sum of a Lambertian and a specular component. The conventional photometric method is generalized for color images. Shadows and highlights in the input images are detected using either spectral or directional cues and excluded from the recovery process, thus giving more reliable estimates of local surface parameters.

[1] S. Barsky, Surface Shape and Color Reconstruction Using Photometric Stereo PhD thesis, School of Electronics and Physical Science, Univ. of Surrey, U.K., 2003.
[2] P.H. Christensen and L.G. Shapiro, Three-Dimensional Shape from Color Photometric Stereo Int'l J. Computer Vision, vol. 13, no. 2, pp. 213-227, 1994.
[3] E.N. Coleman and R. Jain, Obtaining 3-Dimensional Shape of Textured and Specular Surfaces Using Four-Source Photometry Computer Graphics and Image Processing, vol. 18, pp. 309-328, 1982.
[4] M. Drew and M. Brill, Color from Shape from Color: A Simple Formalism with Known Light Sources J. Optical Am. Soc. A, vol. 17, no. 8, pp. 1371-1381, Aug. 2000.
[5] M.S. Drew, Shape from Color Technical Report CSS/LCCR TR 92-07, Simon Fraser School of Computer Science, 1992.
[6] M.S. Drew, Photometric Stereo without Multiple Images Proc. Human Vision and Electronic Imaging, SPIE/IS&T, vol. 3016, pp. 369-380, Feb. 1997.
[7] G.D. Finlayson, J. Dueck, B.V. Funt, and M.S. Drew, Color Eigenfaces Proc. IEEE Third Int'l Workshop Image and Signal Processing, Nov. 1996.
[8] G. Kay and T. Caelly, Estimating the Parameters of an Illumination Model Using Photometric Stereo Graphical Models and Image Processing, vol. 57, no. 5, pp. 365-388, Sept. 1995.
[9] G.J. Klinker, A Physical Approach to Color Image Understanding. A.K. Peters, 1993.
[10] L.L. Kontsevich, A.P. Petrov, and I.S. Vergelskaya, Reconstruction of Shape from Shading in Color Images J. Optical Soc. Am. A, vol. 11, no. 3, pp. 1047-1052, Mar. 1994.
[11] S.W. Lee and R. Bajcsy, Detection of Specularity Using Color and Multiple Views Image and Vision Computing, vol. 10, pp. 643-653, 1992.
[12] S.K. Nayar, K. Ikeuchi, and T. Kanade, "Determining shape and reflectance of hybrid surfaces by photometric sampling," IEEE Trans. Robotics and Automat., vol. 6, no. 4, pp. 418-431, 1990.
[13] A.P. Petrov and G.N. Antonova, Resolving the Color-Image Irradiance Equation Color Research and Application, vol. 21, pp. 97-103, 1996.
[14] B.T. Phong, Illumination for Computer Generated Pictures Comm. ACM, vol. 18, no. 6, 1975.
[15] K. Schlüns and O. Wittig, Photometric Stereo for Non-Lambertian Surfaces Using Color Information Proc. Fifth Int'l Conf. Computer Analysis of Images and Patterns, pp. 444-451, Sept. 1993.
[16] F. Solomon and K. Ikeuchi, Extracting the Shape and Roughness of Specular Lobe Objects Using Four Light Photometric Stereo IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 4, pp. 449-454, Apr. 1996.
[17] H. Tagare and F. de Figueiredo, "A theory of photometric stereo for a class of diffuse non-Lambertian surfaces," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 13, no. 2, pp. 133-152, 1991.
[18] R.J. Woodham, Y. Iwahori, and R.A. Barman, Photometric Stereo: Lambertian Reflectance and Light Sources with Unknown Direction and Strength technical report, Dept. of Computing Science, Univ. of British Columbia, 1991.
[19] R.J. Woodham, Photometric Method for Determining Surface Orientation from Multiple Images Optical Eng., vol. 19, no. 1, pp. 139-144, 1980.
[20] R.J. Woodham, Gradient and Curvature from the Photometric-Stereo Method, Including Local Confidence Estimation J. Optical Soc. Am., vol. 11, no. 11, pp. 3050-3068, Nov. 1994.

Index Terms:
Photometric stereo, surface orientation and color recovery, highlights, shadows.
Svetlana Barsky, Maria Petrou, "The 4-Source Photometric Stereo Technique for Three-Dimensional Surfaces in the Presence of Highlights and Shadows," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 10, pp. 1239-1252, Oct. 2003, doi:10.1109/TPAMI.2003.1233898
Usage of this product signifies your acceptance of the Terms of Use.