This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Relighting Photographs of Tree Canopies
October 2011 (vol. 17 no. 10)
pp. 1459-1474
ASCII Text
x 
 
Marcio Cabral, Nicolas Bonneel, Sylvain Lefebvre, George Drettakis, "Relighting Photographs of Tree Canopies," IEEE Transactions on Visualization and Computer Graphics, vol. 17, no. 10, pp. 1459-1474, October, 2011.
 
 
BibTex
x
 
@article{ 10.1109/TVCG.2010.236,
author = {Marcio Cabral and Nicolas Bonneel and Sylvain Lefebvre and George Drettakis},
title = {Relighting Photographs of Tree Canopies},
journal ={IEEE Transactions on Visualization and Computer Graphics},
volume = {17},
number = {10},
issn = {1077-2626},
year = {2011},
pages = {1459-1474},
doi = {http://doi.ieeecomputersociety.org/10.1109/TVCG.2010.236},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - JOUR
JO - IEEE Transactions on Visualization and Computer Graphics
TI - Relighting Photographs of Tree Canopies
IS - 10
SN - 1077-2626
SP1459
EP1474
EPD - 1459-1474
A1 - Marcio Cabral,
A1 - Nicolas Bonneel,
A1 - Sylvain Lefebvre,
A1 - George Drettakis,
PY - 2011
KW - Image-based rendering
KW - relighting.
VL - 17
JA - IEEE Transactions on Visualization and Computer Graphics
ER -
 
Marcio Cabral, REVES/INRIA, Sophia Antipolis
Nicolas Bonneel, REVES/INRIA, Sophia Antipolis and University of British Columbia, Vancouver
Sylvain Lefebvre, REVES/INRIA, Sophia Antipolis
George Drettakis, REVES/INRIA, Sophia Antipolis
We present an image-based approach to relighting photographs of tree canopies. Our goal is to minimize capture overhead; thus the only input required is a set of photographs of the tree taken at a single time of day, while allowing relighting at any other time. We first analyze lighting in a tree canopy both theoretically and using simulations. From this analysis, we observe that tree canopy lighting is similar to volumetric illumination. We assume a single-scattering volumetric lighting model for tree canopies, and diffuse leaf reflectance; we validate our assumptions with synthetic renderings. We create a volumetric representation of the tree from 10-12 images taken at a single time of day and use a single-scattering participating media lighting model. An analytical sun and sky illumination model provides consistent representation of lighting for the captured input and unknown target times. We relight the input image by applying a ratio of the target and input time lighting representations. We compute this representation efficiently by simultaneously coding transmittance from the sky and to the eye in spherical harmonics. We validate our method by relighting images of synthetic trees and comparing to path-traced solutions. We also present results for photographs, validating with time-lapse ground truth sequences.

[1] Y. Yu and J. Malik, “Recovering Photometric Properties of Architectural Scenes from Photographs,” Proc. ACM SIGGRAPH '98, pp. 207-217, 1998.
[2] Y. Yu, P. Debevec, J. Malik, and T. Hawkins, “Inverse Global Illumination: Recovering Reflectance Models of Real Scenes from Photographs,” Proc. ACM SIGGRAPH '99, 1999.
[3] V. Masselus, P. Peers, P. Dutré, and Y.D. Willems, “Relighting with 4D Incident Light Fields,” ACM Trans. Graphics, vol. 22, no. 3, pp. 613-620, 2003.
[4] S. Boivin and A. Gagalowicz, “Image-Based Rendering of Diffuse, Specular, and Glossy Surfaces from a Single Image,” Proc. ACM SIGGRAPH '01, pp. 107-116, 2001.
[5] C. Loscos, G. Drettakis, and L. Robert, “Interactive Virtual Relighting of Real Scenes,” IEEE Trans. Visualization and Computer Graphics, vol. 6, no. 3, pp. 289-305, http://www-sop.inria.fr/reves/Basilic/2000 LDR00, July-Sept. 2000.
[6] P. Debevec, “Image-Based Lighting,” IEEE Computer Graphics and Applications, vol. 22, no. 2, pp. 26-34, Mar. 2002.
[7] P. Debevec, T. Hawkins, C. Tchou, H.-P. Duiker, W. Sarokin, and M. Sagar, “Acquiring the Reflectance Field of a Human Face,” Proc. ACM SIGGRAPH '00, pp. 145-156, 2000.
[8] P. Peers, N. Tamura, W. Matusik, and P. Debevec, “Post-Production Facial Performance Relighting Using Reflectance Transfer,” ACM Trans. Graphics, vol. 26, no. 3, p. 52, 2007.
[9] B. Neubert, T. Franken, and O. Deussen, “Approximate Image-Based Tree-Modeling Using Particle Flows,” ACM Trans. Graphics, vol. 26, no. 3, p. 88, 2007.
[10] P. Tan, T. Fang, J. Xiao, P. Zhao, and L. Quan, “Single Image Tree Modeling,” ACM Trans. Graphics, vol. 27, no. 5, pp. 1-7, 2008.
[11] A.J. Preetham, P. Shirley, and B. Smits, “A Practical Analytic Model for Daylight,” Proc. ACM SIGGRAPH, 1999.
[12] I. Sato, Y. Sato, and K. Ikeuchi, “Acquiring a Radiance Distribution to Superimpose Virtual Objects onto a Real Scene,” IEEE Trans. Visualization and Computer Graphics, vol. 5, no. 1, pp. 1-12, http://www.hci.iis.u-tokyo.ac.jp/imarik/ publicationsTVCG99.pdf, Jan. 1999.
[13] J.-F. Lalonde, A.A. Efros, and S.G. Narasimhan, “Webcam Clip Art: Appearance and Illuminant Transfer from Time-Lapse Sequences,” ACM Trans. Graphics, vol. 28, no. 5, Dec. 2009.
[14] C. Soler, F.X. Sillion, F. Blaise, and P. Dereffye, “An Efficient Instantiation Algorithm for Simulating Radiant Energy Transfer in Plant Models,” ACM Trans. Graphics, vol. 22, no. 2, pp. 204-233, 2003.
[15] F. de Castro and N. Fetcher, “Three Dimensional Model of the Interception of Light by a Canopy,” Agricultural and Forest Meteorology, vol. 90, no. 3, pp. 215-233, 1998.
[16] E. Cerezo, F. Perez-Cazorla, X. Pueyo, F. Seron, and F. Sillion, “A Survey on Participating Media Rendering Techniques,” The Visual Computer, vol. 21, pp. 303-328, 2005.
[17] K. Boulanger, K. Bouatouch, and S.N. Pattanaik, “Rendering Trees with Indirect Lighting in Real Time,” Computer Graphics Forum, vol. 27, no. 4, pp. 1189-1198, 2008.
[18] I. Shlyakhter, M. Rozenoer, J. Dorsey, and S.J. Teller, “Reconstructing 3D Tree Models from Instrumented Photographs,” IEEE Computer Graphics and Applications, vol. 21, no. 3, pp. 53-61, May/June 2001.
[19] A. Reche, I. Martin, and G. Drettakis, “Volumetric Reconstruction and Interactive Rendering of Trees from Photographs,” ACM Trans. Graphics, vol. 23, no. 3,http://www-sop.inria.fr/reves/Basilic/2004 RMD04, July 2004.
[20] P. Debevec, “Rendering Synthetic Objects into Real Scenes: Bridging Traditional and Image-Based Graphics with Global Illumination and High Dynamic Range Photography,” Proc. ACM SIGGRAPH '98, pp. 189-198, 1998.
[21] H. Rahman, B. Pinty, and M. Verstraete, “Coupled Surface-Atmosphere Reflectance (CSAR) Model 2. Semiempirical Surface Model Usable with NOAA Advanced Very High Resolution Radiometer Data,” J. Geophysical Research, vol. 98, no. D11, pp. 20791-20801, 1993.
[22] S.R. Marschner and D.P. Greenberg, “Inverse Lighting for Photography,” Proc. Fifth Color Imaging Conf. Soc. for Imaging Science and Technology, pp. 262-265, 1997.
[23] Z. Liu, Y. Shan, and Z. Zhang, “Expressive Expression Mapping with Ratio Images,” Proc. ACM SIGGRAPH '01 pp. 271-276, 2001.
[24] A. Shashua and T. Riklin-Raviv, “The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 2, pp. 129-139, Feb. 2001.
[25] A. Stoschek, “Image-Based Re-Rendering of Faces for Continuous Pose and Illumination Directions,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. 1, p. 1582, 2000.
[26] M. Pharr and G. Humphreys, Physically Based Rendering: From Theory to Implementation. Morgan Kaufmann Publishers, Inc., 2004.
[27] F. Perez-Cazorla, X. Pueyo, and F. Sillion, “Global Illumination Techniques for the Simulation of Participating Media,” Proc. Eighth Eurographics Workshop Rendering, June 1997.
[28] J.T. Kajiya and B.P. Von Herzen, “Ray Tracing Volume Densities,” ACM SIGGRAPH Computer Graphics, vol. 18, no. 3, pp. 165-174, 1984.
[29] F. Kasten and A. Young, “Revised Optical Air Mass Tables and Approximation Formula,” Applied Optics, vol. 28, pp. 4735-4738, 1989.
[30] P.-P. Sloan, J. Kautz, and J. Snyder, “Precomputed Radiance Transfer for Real-Time Rendering in Dynamic, Low-Frequency Lighting Environments,” Proc. ACM SIGGRAPH '02, pp. 527-536, 2002.
[31] J. Jansen and L. Bavoil, “Fourier Opacity Mapping,” Proc. ACM SIGGRAPH Symp. Interactive 3D Graphics and Games (I3D '10), pp. 165-172, 2010.
[32] R. Habel, B. Mustata, and M. Wimmer, “Efficient Spherical Harmonics Lighting with the Preetham Skylight Model,” Proc. Ann. Conf. European Assoc. Computer Graphics (Eurographics '08)—Short Papers, http://www.cg.tuwien.ac.at/research/ publications/ 2008Habel_08_SSH/, Apr. 2008.
[33] A. Levin, D. Lischinski, and Y. Weiss, “A Closed-Form Solution to Natural Image Matting,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 2, pp. 228-242, Feb. 2008.
[34] N. Snavely, S.M. Seitz, and R. Szeliski, “Modeling the World from Internet Photo Collections,” Int'l J. Computer Vision, vol. 80, no. 2, pp. 189-210, http:/phototour.cs.washington.edu/, Nov. 2008.
[35] G. Zotti, A. Wilkie, and W. Purgathofer, “A Critical Review of the Preetham Skylight Model,” J. WSCG, vol. 15, 2007.

Index Terms:
Image-based rendering, relighting.
Citation:
Marcio Cabral, Nicolas Bonneel, Sylvain Lefebvre, George Drettakis, "Relighting Photographs of Tree Canopies," IEEE Transactions on Visualization and Computer Graphics, vol. 17, no. 10, pp. 1459-1474, Oct. 2011, doi:10.1109/TVCG.2010.236
Usage of this product signifies your acceptance of the Terms of Use.