This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Mixture of Spherical Distributions for Single-View Relighting
January 2008 (vol. 30 no. 1)
pp. 25-35
ASCII Text
x 
 
Kenji Hara, Ko Nishino, Katsushi Ikeuchi, "Mixture of Spherical Distributions for Single-View Relighting," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 1, pp. 25-35, January, 2008.
 
 
BibTex
x
 
@article{ 10.1109/TPAMI.2007.1164,
author = {Kenji Hara and Ko Nishino and Katsushi Ikeuchi},
title = {Mixture of Spherical Distributions for Single-View Relighting},
journal ={IEEE Transactions on Pattern Analysis and Machine Intelligence},
volume = {30},
number = {1},
issn = {0162-8828},
year = {2008},
pages = {25-35},
doi = {http://doi.ieeecomputersociety.org/10.1109/TPAMI.2007.1164},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - JOUR
JO - IEEE Transactions on Pattern Analysis and Machine Intelligence
TI - Mixture of Spherical Distributions for Single-View Relighting
IS - 1
SN - 0162-8828
SP25
EP35
EPD - 25-35
A1 - Kenji Hara,
A1 - Ko Nishino,
A1 - Katsushi Ikeuchi,
PY - 2008
KW - Inverse rendering
KW - Von Mises-Fisher distribution
KW - Finite mixture distibution
KW - EM algorithm
VL - 30
JA - IEEE Transactions on Pattern Analysis and Machine Intelligence
ER -
 
We present a method for simultaneously estimating the illumination of a scene and the reflectance property of an object from single view images – a single image or a small number of images taken from the same viewpoint. We assume that the illumination consists of multiple point light sources and the shape of the object is known. First, we represent the illumination on the surface of a unit sphere as a finite mixture of von Mises-Fisher distributions based on a novel spherical specular reflection model that well approximates the Torrance-Sparrow reflection model. Next, we estimate the parameters of this mixture model including the number of its component distributions and the standard deviation of them, which correspond to the number of light sources and the surface roughness, respectively. Finally, using these results as the initial estimates, we iteratively refine the estimates based on the original Torrance-Sparrow reflection model. The final estimates can be used to relight single-view images such as altering the intensities and directions of the individual light sources. The proposed method provides a unified framework based on directional statistics for simultaneously estimating the intensities and directions of an unknown number of light sources as well as the specular reflection parameter of the object in the scene.

[1] A. Banerjee, I. Dhillon, J. Ghosh, and S. Sra, “Generative Model-Based Clustering of Directional Data,” Proc. Ninth ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining, pp. 19-28, 2003.
[2] S. Boivin and A. Gagalowicz, “Image-Based Rendering of Diffuse, Specular and Glossy Surfaces from a Single Image,” Proc. ACM SIGGRAPH, pp. 197-216, 2001.
[3] S. Cang and D. Partridge, “Determining the Number of Components in Mixture Models using Williams' Statistical Test,” Proc. Eighth Int'l Conf. Neural Information Processing, pp. 14-18, 2003.
[4] A.P. Dempster, N.M. Laird, and D.B. Rubin, “Maximum-Likelihood from Incomplete Data via the EM Algorithm,” J. Royal Statistical Soc. B, pp. 1-38, 1977.
[5] G. Drettakis, L. Robert, and S. Bougnoux, “Interactive Common Illumination for Computer Augmented Reality,” Proc. Eurographics Rendering Workshop, pp. 45-56, 1997.
[6] M. Figueiredo and A.K. Jain, “Unsupervised Learning of Finite Mixture Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 3, pp. 381-396, Mar. 2002.
[7] R.A. Fisher, “Dispersion on a Sphere,” Proc. Royal Soc. London, Series A, vol. 217, pp. 295-305, 1953.
[8] A. Fournier, A.S. Gunawan, and C. Romanzin, “Common Illumination between Real and Computer Generated Scenes,” Proc. Graphics Interface, pp. 254-262, 1993.
[9] K. Hara, K. Nishino, and K. Ikeuchi, “Determining Reflectance and Light Position from a Single Image without Distant Illumination Assumption,” Proc. lnt'l Conf. Computer Vision, pp. 560-567, 2003.
[10] D.R. Hougen and N. Ahuja, “Estimation of the Light Source Distribution and Its Use in Integrated Shape Recovery from Stereo Shading,” Proc. Int'l Conf. Computer Vision, pp. 148-155, 1993.
[11] K. Ikeuchi and K. Sato, “Determining Reflectance Properties of an Object Using Range and Brightness Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 11, pp. 1139-1153, Nov. 1991.
[12] C.-Y. Kim, A.P. Petrov, H.-K. Choh, Y.-S. Seo, and I.-S. Kweon, “Illuminant Direction and Shape of a Bump,” J. Optical Soc. Am. A, vol. 15, no. 9, pp. 2341-2350, 1998.
[13] G. Klinker, S. Shafer, and T. Kanade, “A Physical Approach to Color Image Understanding,” lnt'l J. Computer Vision, vol. 4, pp. 7-38, 1990.
[14] Y. Li, S. Lin, H. Lu, and H. Shum, “Multiple-Cue Illumination Estimation in Textured Scenes,” Proc. Int'l Conf. Computer Vision, pp. 1366-1373, 2003.
[15] K.V. Mardia and P.E. Jupp, Directional Statistics. John Wiley & Sons, 2000.
[16] S.R. Marschner and D.P. Greenberg, “Inverse Lighting for Photography,” Proc. Fifth Color Imaging Conf., Soc. Imaging Science and Technology, pp. 262-265, 1997.
[17] D. Miyazaki, R.T. Tan, K. Hara, and K. Ikeuchi, “Polarization-Based Inverse Rendering from a Single View,” Proc. Int'l Conf. Computer Vision, pp. 982-987, 2003.
[18] N. Mukawa, “Estimation of Shape, Reflection Coefficients and Illuminant Direction from Image Sequences,” Proc. Int'l Conf. Computer Vision, pp. 507-512, 1990.
[19] S. Nayar, K. Ikeuchi, and T. Kanade, “Surface Reflection: Physical and Geometrical Perspectives,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 7, pp. 611-634, July 1991.
[20] K. Nishino, Z. Zhang, and K. Ikeuchi, “Determining Reflectance Parameters and Illumination Distribution from a Sparse Set of Images for View-Dependent Image Synthesis,” Proc. Int'l Conf. Computer Vision, pp. 599-606, 2001.
[21] K. Nishino, K. Ikeuchi, and Z. Zhang, “Re-Rendering from a Sparse Set of Images,” Technical Report DU-CS-05-12, Dept. of Computer Science, Drexel Univ., Nov. 2005.
[22] T. Okabe, I. Sato, and Y. Sato, “Spherical Harmonics vs. Haar Wavelets: Basis for Recovering Illumination from Cast Shadows,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 50-57, 2004.
[23] A.P. Pentland, “Finding the Illumination Direction,” J. Optical Soc. Am. A, vol. 72, no. 4, pp. 448-455, 1982.
[24] http://radsite.lbl.gov/radianceHOME.html , 1997.
[25] R. Ramamoorthi and P. Hanrahan, “A Signal-Processing Framework for Inverse Rendering,” Proc. ACM SIGGRAPH, pp. 117-128, 2001.
[26] I. Sato, Y. Sato, and K. Ikeuchi, “Illumination from Shadows,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 3, pp. 290-300, Mar. 2003.
[27] S. Shafer, “Using Color to Separate Reflection Components,” COLOR Research and Application, vol. 10, no. 4, pp. 210-218, 1985.
[28] L. Shen and H. Takemura, “Spatial Reflectance Recovery Under Complex Illumination from Sparse Images,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 1833-1838, 2006.
[29] F. Solomon and K. Ikeuchi, “Extracting the Shape and Roughness of Specular Lobe Objects Using Four Light Photometric Stereo,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 466-471, 1992.
[30] R.T. Tan and K. Ikeuchi, “Separating Reflection Components of Textured Surfaces from a Single Image,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 2, pp. 178-193, Feb. 2005.
[31] S. Tominaga and N. Tanaka, “Estimating Reflection Parameters from a Single Color Image,” IEEE Computer Graphics and Applications, vol. 20, no. 5, pp. 58-66, Sept./Oct. 2000.
[32] K.E. Torrance and E.M. Sparrow, “Theory of Off-Specular Reflection from Roughened Surfaces,” J. Optical Soc. Am. A, vol. 57, pp. 1105-1114, 1967.
[33] J. Verbeek, N. Vlassis, and B. Krose, “Efficient Greedy Learning of Gaussian Mixture Models,” Neural Computation, vol. 15, no. 2, pp.469-485, 2003.
[34] Y. Wang and D. Samaras, “Estimation of Multiple Illuminants from a Single Image of Arbitrary Known Geometry,” Proc. European Conf. Computer Vision, pp. 272-288, 2002.
[35] Y. Wang and D. Samaras, “Estimation of Multiple Directional Light Sources for Synthesis of Augmented Reality Images,” Graphical Models, vol. 65, no. 4, pp. 185-205, 2003.
[36] G. Ward, “Measuring and Modeling Anisotoropic Reflection,” Proc. ACM SIGGRAPH '92, pp. 265-272, 1992.
[37] G.S. Watson and E.J. Williams, “On the Construction of Significance Tests on the Circle and the Sphere,” Biometrika, vol. 43, pp. 344-352, 1956.
[38] Y. Yang and A. Yuille, “Source from Shading,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 534-539, 1991.
[39] Y. Yu, P. Debevec, J. Malik, and T. Hawkins, “Inverse Global Illumination: Recovering Reflectance Models of Real Scenes from Photographs,” Proc. ACM SIGGRAPH, pp. 215-224, 1999.
[40] Y. Yu and J. Malik, “Recovering Photometric Properties of Architectural Scenes from Photographs,” Proc. ACM SIGGRAPH, pp. 207-217, 1998.
[41] Y. Zhang and Y.H. Yang, “Multiple Illuminant Direction Detection with Application to Image Synthesis,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 8, pp. 915-920, Aug. 2001.
[42] Q. Zheng and R. Chellappa, “Estimation of Illuminant Direction, Albedo, and Shape from Shading,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 7, pp. 680-702, July 1991.
[43] W. Zhou and C. Kambhamettu, “Estimation of Illuminant Direction and Intensity of Multiple Light Sources,” Proc. European Conf. Computer Vision, pp. 206-220, 2002.

Index Terms:
Inverse rendering, Von Mises-Fisher distribution, Finite mixture distibution, EM algorithm
Citation:
Kenji Hara, Ko Nishino, Katsushi Ikeuchi, "Mixture of Spherical Distributions for Single-View Relighting," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 1, pp. 25-35, Jan. 2008, doi:10.1109/TPAMI.2007.1164
Usage of this product signifies your acceptance of the Terms of Use.