This Article 
 Bibliographic References 
 Add to: 
Retrieving Shape Information from Multiple Images of a Specular Surface
February 1994 (vol. 16 no. 2)
pp. 195-201

In many remote sensing and machine vision applications, the shape of a specular surface such as water, glass, or polished metal must be determined instantaneously and under natural lighting conditions. Most image analysis techniques, however, assume surface reflectance properties or lighting conditions that are incompatible with these situations. To retrieve the shape of smooth specular surfaces, a technique known as specular surface stereo was developed. The method analyzes multiple images of a surface and finds a surface shape that results in a set of synthetic images that match the observed ones. An image synthesis model is used to predict image irradiance values as a function of the shape and reflectance properties of the surface, camera geometry, and radiance distribution of the illumination. The specular surface stereo technique was tested by processing four numerical simulations-a water surface illuminated by a low- and high-contrast extended light source, and a mirrored surface illuminated by a low- and high-contrast extended light source. Under these controlled circumstances, the recovered surface shape showed good agreement with the known input.

[1] A. Blake, "Specular stereo," inProc. 9th Int. Joint Conf. Artificial Intell. (IJCAI), vol. 2, pp. 973-976, 1985.
[2] A. Blake and G. Brelstaff, "Geometry from specularities," inProc. 2nd ICCV, pp. 394-403, 1988.
[3] M. Born and E. Wolf,Principles of Optics, 6th ed. New York: Pergamon, 1980.
[4] E. N. Coleman and R. Jain, "Obtaining 3-dimensional shape of textured and specular surface using four-source photometry,"Comput. Graphics Image Processing, vol. 18, pp. 309-328, Apr. 1982.
[5] L. Piegl and W. Tiller, "Curve and Surface Constructions Using Rational B-Splines,"Computer-Aided Design, Vol. 19, No. 9, Nov. 1987, pp. 485-498.
[6] G. Healey and T. O. Benford, "Local shape from specularity," inProc. Image Understanding Workshop, Los Angeles, CA, 1987, pp. 874-887.
[7] B. K. P. Horn,Robot Vision. Cambridge, MA: M.I.T. Press, 1986.
[8] B. K. P. Horn and M. J. Brooks, Eds.Shape from Shading. Cambridge MA: MIT Press, 1989.
[9] K. Ikeuchi, "Determining surface orientations of specular surfaces by using the photometric stereo method,"IEEE Trans. Pattern Analysis Machine Intell., vol. PAMI-3, no. 6, pp. 661-669, Nov. 1981.
[10] D. Marr and T. Poggio, "Cooperative computation of stereo disparity,"Science, vol. 194, pp. 283-287, 1976.
[11] H. Murase, "Surface shape reconstruction of a nonrigid transparent object using refraction and motion,"IEEE Trans. Pattern Analysis Machine Intell., vol. PAMI-14, pp. 1045-1052, Oct. 1992.
[12] S. K. Nayar, K. Ikeuchi, and T. Kanade, "Extracting shape and reflectance of hybrid surfaces by photometric sampling," inProc. Image Understanding Workshop, Palo Alto, CA, 1989.
[13] S. K. Nayar, K. Ikeuchi, and T. Kanade, "Surface reflection: Physical and geometric perspectives,"IEEE Trans. Pattern Analysis and Machine Intell., vol. PAMI-13, pp. 611-634, July 1991.
[14] A. C. Sanderson, L. E. Weiss, and S. K. Nayar, "Structured highlight inspection of specular surfaces,"IEEE Trans. Pattern Analysis and Machine Intell., vol. PAMI-10, pp. 44-55, 1988.
[15] C. C. Slama, Ed.,Manual of Photogrammetry, 4th ed. Falls Church, VA: American Society of Photogrammetry, 1980.
[16] H. D. Tagare and R. J. P. deFigueiredo, "A theory of photometric stereo for a general class of reflectance maps," inProc. IEEE Conf. Comput. Vision Patt. Recognition (CVPR)(San Diego, CA), June 1989, pp. 38-45.
[17] J. Thomas, W. Kober, and F. Leberl, "Multiple image SAR shape-from-shading,Photometric Engineering and Remote Sensing, vol. 57, pp. 51-59, Jan. 1991.
[18] L. B. Wolff and T. E. Boult, "Contrasting object features using a polarization reflection model,"IEEE Trans. Pattern Analysis and Machine Intell., vol. PAMI-13, pp. 635-657, July 1991.
[19] R. J. Woodham, "Photometric stereo: A reflectance map technique for determining surface orientation from image intensity," inProc. SPIE 22nd Ann. Tech. Symp., vol. 155, pp. 136-143, San Diego, CA, 1978.
[20] A. Zisserman, P. Giblin, and A. Blake, "The information available to a moving observer from specularities,"Image and Vision Computing, vol. 7, pp. 38-42, Feb. 1989.

Index Terms:
stereo image processing; shape information retrieval; multiple images; remote sensing; machine vision; reflective surface; image analysis; specular surface stereo; image synthesis; image irradiance; camera geometry; radiance distribution; mirrored surface; water surface; shape from shading
H. Schultz, "Retrieving Shape Information from Multiple Images of a Specular Surface," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 16, no. 2, pp. 195-201, Feb. 1994, doi:10.1109/34.273732
Usage of this product signifies your acceptance of the Terms of Use.