This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Light Source Position and Reflectance Estimation from a Single View without the Distant Illumination Assumption
April 2005 (vol. 27 no. 4)
pp. 493-505
ASCII Text
x 
 
Kenji Hara, Ko Nishino, Katsushi Ikeuchi, "Light Source Position and Reflectance Estimation from a Single View without the Distant Illumination Assumption," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 4, pp. 493-505, April, 2005.
 
 
BibTex
x
 
@article{ 10.1109/TPAMI.2005.82,
author = {Kenji Hara and Ko Nishino and Katsushi Ikeuchi},
title = {Light Source Position and Reflectance Estimation from a Single View without the Distant Illumination Assumption},
journal ={IEEE Transactions on Pattern Analysis and Machine Intelligence},
volume = {27},
number = {4},
issn = {0162-8828},
year = {2005},
pages = {493-505},
doi = {http://doi.ieeecomputersociety.org/10.1109/TPAMI.2005.82},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - JOUR
JO - IEEE Transactions on Pattern Analysis and Machine Intelligence
TI - Light Source Position and Reflectance Estimation from a Single View without the Distant Illumination Assumption
IS - 4
SN - 0162-8828
SP493
EP505
EPD - 493-505
A1 - Kenji Hara,
A1 - Ko Nishino,
A1 - Katsushi Ikeuchi,
PY - 2005
KW - Finite distance illumination
KW - light source position estimation
KW - reflectance parameter estimation
KW - specular reflectance.
VL - 27
JA - IEEE Transactions on Pattern Analysis and Machine Intelligence
ER -
 
Several techniques have been developed for recovering reflectance properties of real surfaces under unknown illumination. However, in most cases, those techniques assume that the light sources are located at inifinity, which cannot be applied safely to, for example, reflectance modeling of indoor environments. In this paper, we propose two types of methods to estimate the surface reflectance property of an object, as well as the position of a light source from a single view without the distant illumination assumption, thus relaxing the conditions in the previous methods. Given a real image and a 3D geometric model of an object with specular reflection as inputs, the first method estimates the light source position by fitting to the Lambertian diffuse component, while separating the specular and diffuse components by using an iterative relaxation scheme. Our second method extends that first method by using as input a specular component image, which is acquired by analyzing multiple polarization images taken from a single view, thus removing its constraints on the diffuse reflectance property. This method simultaneously recovers the reflectance properties and the light source positions by optimizing the linearity of a log-transformed Torrance-Sparrow model. By estimating the object's reflectance property and the light source position, we can freely generate synthetic images of the target object under arbitrary lighting conditions with not only source direction modification but also source-surface distance modification. Experimental results show the accuracy of our estimation framework.

[1] S. Boivin and A. Gagalowicz, “Image-Based Rendering of Diffuse, Specular and Glossy Surfaces from a Single Image,” Proc. SIGGRAPH Conf., pp. 197-216, 2001.
[2] M.J. Brooks and B.K.P. Horn, “Shape and Source from Shading,” Proc. Int'l Joint Conf. Artificial Intelligence, pp. 932-936, 1985.
[3] G.D. Finlayson and G. Schaefer, “Solving for Color Constancy Using Constrained Dichromatic Reflection Model,” Int'l J. Computer Vision, vol. 42, no. 3, pp. 127-144, 2001.
[4] B. Horn and M. Brooks, Shape from Shading. Cambridge, Mass.: MIT Press, 1989.
[5] D.R. Hougen and N. Ahuja, “Estimation of the Light Source Distribution and Its Use in Integrated Shape Recovery from Stereo Shading,” Proc. IEEE Int'l Conf. Computer Vision, pp. 148-155, 1993.
[6] K. Ikeuchi and B.K.P. Horn, “Numerical Shape for Shading and Occluding Boundaries,” Artificial Intelligence, vol. 17, nos. 1-3, pp. 141-184, 1981.
[7] K. Ikeuchi and K. Sato, “Determining Reflectance Properties of an Object Using Range and Brightness Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 11, pp. 1139-1153, 1991.
[8] C.-Y. Kim, A.P. Petrov, H.-K. Choh, Y.-S. Seo, and I.-S. Kweon, “Illuminant Direction and Shape of a Bump,” J. Optical Soc. Am., vol. 15, no. 9, pp. 2341-2350, 1998.
[9] G.J. Klinker, S.A. Shafer, and T. Kanade, “Using a Color Reflection Model to Separate Highlights from Object Color,” Proc. IEEE Int'l Conf. Computer Vision, pp. 145-150, 1987.
[10] Y. Li, S. Lin, H. Lu, and H. Shum, “Multiple-Cue Illumination Estimation in Textured Scenes,” Proc. IEEE Int'l Conf. Computer Vision, pp. 1366-1373, 2003.
[11] S.R. Marschner and D.P. Greenberg, “Inverse Lighting for Photography,” Proc. Fifth Color Imaging Conf., Soc. Imaging Science and Tech nology, pp. 262-265, 1997.
[12] D. Miyazaki, R.T. Tan, K. Hara, and K. Ikeuchi, “Polarization-Based Inverse Rendering from a Single View,” Proc. IEEE Int'l Conf. Computer Vision, pp. 982-987, 2003.
[13] N. Mukawa, “Estimation of Shape, Reflection Coefficients and Illuminant Direction from Image Sequences,” Proc. IEEE Int'l Conf. Computer Vision, pp. 507-512, 1990.
[14] S.K. Nayar, K. Ikeuchi, and T. Kanade, “Surface Reflection: Physical and Geometrical Perspectives,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 7, pp. 611-634, 1991.
[15] S.K. Nayar, X. Fang, and T.E. Boult, “Removal of Specularities Using Color and Polarization,” Proc. Computer Vision and Pattern Recognition, pp. 583-590, 1993.
[16] K. Nishino, Z. Zhang, and K. Ikeuchi, “Determining Reflectance Parameters and Illumination Distribution from a Sparse Set of Images for View-Dependent Image Synthesis,” Proc. IEEE Int'l Conf. Computer Vision, pp. 599-606, 2001.
[17] K. Nishino, “Photometric Object Modeling— Rendering from a Dense/Sparse Set of Images— ,” PhD thesis, The Univ. of Tokyo, 2002.
[18] T. Okatani and K. Deguchi, “Shape Reconstruction from an Endoscope Image by Shape from Shading Technique for a Point Light Source at the Projection Center,” Computer Vision and Image Understanding, vol. 66, no. 2, pp. 119-131, 1997.
[19] A.P. Pentland, “Finding the Illuminant Direction,” J. Optical Soc. Am., vol. 72, pp. 448-455, 1982.
[20] http://radsite.lbl.gov/radianceHOME.html , 1997.
[21] R. Ramamoorthi and P. Hanrahan, “Analysis of Planar Light Fields from Homogeneous Convex Curved Surfaces under Distant Illumination,” Proc. SPIE, Human Vision and Electronic Imaging VI, pp. 185-198, 2001.
[22] R. Ramamoorthi and P. Hanrahan, “A Signal Processing Framework for Inverse Rendering,” Proc. SIGGRAPH Conf., pp. 117-128, 2001.
[23] I. Sato, Y. Sato, and K. Ikeuchi, “Acquiring a Radiance Distribution to Superimpose Virtual Objects onto a Real Scene,” Proc Int'l Assoc. Pattern Recognition Workshop Machine Vision Applications, pp. 19-22, 1998.
[24] I. Sato, Y. Sato, and K. Ikeuchi, “Ilumination Distribution from Shadows,” Proc. IEEE Conf. Computer Vision and Pattern Recogition, pp. 306-312, 1999.
[25] I. Sato, Y. Sato, and K. Ikeuchi, “Illumination Distribution from Brightness in Shadows: Adaptive Estimation of Illumination Distribution with Unknown Reflectance Properties in Shadow Regions,” Proc. IEEE Int'l Conf. Computer Vision, pp. 875-882, 1999.
[26] Y. Sato, M. Wheeler, and K. Ikeuchi, “Object Shape and Reflectance Modeling from Observation,” Proc. SIGGRAPH, pp. 379-387, 1997.
[27] S. Shafer, “Using Color to Separate Reflection Components,” COLOR Research and Application, vol. 10, pp. 210-218, 1985.
[28] R.T. Tan, K. Nishino, and K. Ikeuchi, “Separating Diffuse and Specular Reflection Components Based on Surface Color Ratio and Chromaticity,” Proc. Int'l Assoc. Pattern Recognition Workshop Machine Vision Applications, pp. 14-19, 2002.
[29] S. Tominaga and N. Tanaka, “Estimating Reflection Parameters from a Single Color Image,” IEEE Computer Graphics and Applications, vol. 20, no. 5, pp. 58-66, 2000.
[30] K.E. Torrance and E.M. Sparrow, “Theory of Off-Specular Reflection from Roughened Surfaces,” J. Optical Soc. Am., vol. 57, pp. 1105–1114, 1967.
[31] Y. Wang and D. Samaras, “Estimation of Multiple Illuminants from a Single Image of Arbitrary Known Geometry,” Proc. European Conf. Computer Vision, pp. 272-288, 2002.
[32] Y. Wang and D. Samaras, “Estimation of Multiple Directional Light Sources for Synthesis of Augmented Reality Images,” Graphical Models, vol. 65, no. 4, pp. 185-205, 2003.
[33] G.J. Ward, “Measuring and Modeling Anisotoropic Reflection,” Proc. SIGGRAPH Conf., pp. 265-272, 1992.
[34] L.B. Wolff and T.E. Boult, “Constraining Object Features Using a Polarization Reflectance Model,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 6, pp. 167-189, 1991.
[35] Y. Yang and A. Yuille, “Source from Shading,” Proc. IEEE Conf. Computer Vision and Pattern Recogition, pp. 534-539, 1991.
[36] Y. Zhang and Y.H. Yang, “Multiple Illuminant Direction Detection with Application to Image Synthesis,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 8, pp. 915-920, 2001.
[37] Q. Zheng and R. Chellappa, “Estimation of Illuminant Direction, Albedo, and Shape from Shading,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 7, pp. 680-702, 1991.

Index Terms:
Finite distance illumination, light source position estimation, reflectance parameter estimation, specular reflectance.
Citation:
Kenji Hara, Ko Nishino, Katsushi Ikeuchi, "Light Source Position and Reflectance Estimation from a Single View without the Distant Illumination Assumption," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 4, pp. 493-505, April 2005, doi:10.1109/TPAMI.2005.82
Usage of this product signifies your acceptance of the Terms of Use.