The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.10 - October (2011 vol.33)
pp: 2122-2128
Manmohan Chandraker , University of California, Berkeley, Berkeley
Jiamin Bai , University of California, Berkeley, Berkeley
Tian-Tsong Ng , Institute for Infocomm Research, Singapore
Ravi Ramamoorthi , University of California, Berkeley, Berkeley
ABSTRACT
Inverse light transport seeks to undo global illumination effects, such as interreflections, that pervade images of most scenes. This paper presents the theoretical and computational foundations for inverse light transport as a dual of forward rendering. Mathematically, this duality is established through the existence of underlying Neumann series expansions. Physically, it can be shown that each term of our inverse series cancels an interreflection bounce, just as the forward series adds them. While the convergence properties of the forward series are well known, we show that the oscillatory convergence of the inverse series leads to more interesting conditions on material reflectance. Conceptually, the inverse problem requires the inversion of a large light transport matrix, which is impractical for realistic resolutions using standard techniques. A natural consequence of our theoretical framework is a suite of fast computational algorithms for light transport inversion—analogous to finite element radiosity, Monte Carlo and wavelet-based methods in forward rendering—that rely at most on matrix-vector multiplications. We demonstrate two practical applications, namely, separation of individual bounces of the light transport and fast projector radiometric compensation, to display images free of global illumination artifacts in real-world environments.
INDEX TERMS
Light transport, rendering equation, inverse light transport, duality theory, interreflections, radiometric compensation.
CITATION
Manmohan Chandraker, Jiamin Bai, Tian-Tsong Ng, Ravi Ramamoorthi, "On the Duality of Forward and Inverse Light Transport", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.33, no. 10, pp. 2122-2128, October 2011, doi:10.1109/TPAMI.2011.124
REFERENCES
[1] J. Kajiya, "The Rendering Equation," Proc. ACM SIGGRAPH, pp. 143-150, 1986.
[2] S. Seitz, Y. Matsushita, and K. Kutulakos, "A Theory of Inverse Light Transport," Proc. IEEE Int'l Conf. Computer Vision, pp. 1440-1447, 2005.
[3] P. Peers, K. Berge, W. Matusik, R. Ramamoorthi, J. Lawrence, S. Rusinkiewicz, and P. Dutre, "A Compact Factored Representation of Heterogeneous Subsurface Scattering," ACM Trans. Graphics, vol. 25, no. 3, pp. 746-753, 2006.
[4] V. Masselus, P. Peers, P. Dutre, and Y. Willems, "Relighting with 4D Incident Light Fields," ACM Trans. Graphics, vol. 22, no. 3, pp. 613-620, 2003.
[5] T.-T. Ng, R.S. Pahwa, J. Bai, Q.-S. Quek, and K.-H. Tan, "Radiometric Compensation Using Stratified Inverses," Proc. IEEE Int'l Conf. Computer Vision, 2009.
[6] P. Debevec, T. Hawkins, C. Tchou, H. Duiker, W. Sarokin, and M. Sagar, "Acquiring the Reflectance Field of a Human Face," Proc. ACM SIGGRAPH, pp. 145-156, 2000.
[7] G. Wetzstein and O. Bimber, "Radiometric Compensation through Inverse Light Transport," Proc. Pacific Conf. Computer Graphics and Applications, pp. 391-399, 2007.
[8] S. Liu, T.-T. Ng, and Y. Matsushita, "Shape from Second Bounce of Light Transport," Proc. European Conf. Computer Vision, 2010.
[9] M. Cohen and J. Wallace, Radiosity and Realistic Image Synthesis. Academic Press, 1993.
[10] E. Veach, "Robust Monte Carlo Methods for Light Transport Simulation," PhD dissertation, Stanford Univ., 1998.
[11] J. Bai, M. Chandraker, T.-T. Ng, and R. Ramamoorthi, "A Dual Theory of Inverse and Forward Light Transport," Proc. European Conf. Computer Vision, 2010.
[12] S. Marschner, "Inverse Rendering for Computer Graphics," PhD dissertation, Cornell Univ., 1998.
[13] R. Ramamoorthi and P. Hanrahan, "A Signal-Processing Framework for Inverse Rendering," Proc. ACM SIGGRAPH, pp. 117-128, 2001.
[14] Y. Yu, P. Debevec, J. Malik, and T. Hawkins, "Inverse Global Illumination: Recovering Reflectance Models of Real Scenes from Photographs," Proc. ACM SIGGRAPH, pp. 215-224, 1999.
[15] J. Arvo, K. Torrance, and B. Smits, "A Framework for the Analysis of Error in Global Illumination Algorithms," Proc. ACM SIGGRAPH, pp. 75-84, 1994.
[16] G. Golub and C. van Loan, Matrix Computations. John Hopkins Univ. Press, 1996.
[17] J. Demmel, Applied Numerical Linear Algebra. SIAM, 1997.
[18] G. Forsythe and R. Leibler, "Matrix Inversion by a Monte Carlo Method," Math. Tables and Other Aids to Computation, vol. 4, no. 31, pp. 127-129, July 1950.
[19] O. Bimber, A. Grundhoefer, T. Zeidler, D. Danch, and P. Kapakos, "Compensating Indirect Scattering for Immersive and Semi-Immersive Projection Displays," Proc. IEEE Virtual Reality, pp. 151-158, 2006.
[20] M. O'Toole and K. Kutulakos, "Optical Computing for Fast Light Transport Analysis," Proc. SIGGRAPH Asia 2010 Papers, 2010.
[21] K. Fujii, M. Grossberg, and S. Nayar, "A Projector-Camera System with Real-Time Photometric Adaptation for Dynamic Environments," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
[22] Y. Ding, J. Xiao, K.-H. Tan, and J. Yu, "Catadioptric Projectors," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[23] R. Raskar, G. Welch, K. Low, and D. Bandyopadhyay, "Shader Lamps," Proc. EuroGraphics Workshop Rendering, 2001.
[24] S. Nayar, G. Krishnan, M. Grossberg, and R. Raskar, "Fast Separation of Direct and Global Components of a Scene Using High Frequency Illumination," ACM Trans. Graphics, vol. 25, no. 3, pp. 935-944, 2006.
[25] Y. Mukaigawa, T. Kakinuma, and Y. Ohta, "Analytical Compensation of Inter-Reflection for Pattern Projection," Proc. ACM Symp. Virtual Reality Software and Technology (VRST), pp. 265-268, 2006.
[26] J. Bai, M. Chandraker, T.-T. Ng, and R. Ramamoorthi, "A Dual Theory of Inverse and Forward Light Transport," Technical Report UCB/EECS-2010-101, Univ. of California Berkeley, 2010.
[27] S. Gortler, P. Schröder, M. Cohen, and P. Hanrahan, "Wavelet Radiosity," Proc. ACM SIGGRAPH, pp. 221-230, 1993.
[28] R. Ng, R. Ramamoorthi, and P. Hanrahan, "All-Frequency Shadows Using Non-Linear Wavelet Lighting Approximation," ACM Trans. Graphics, vol. 22, no. 3, pp. 376-381, 2003.
[29] P. Hanrahan, D. Salzman, and L. Aupperle, "A Rapid Hierarchical Radiosity Algorithm," Proc. ACM SIGGRAPH, pp. 197-206, 1991.
[30] P.H. Christensen, E.J. Stollnitz, D.H. Salesin, and T.D. DeRose, "Global Illumination of Glossy Environments Using Wavelets and Importance," ACM Trans. Graphics, vol. 15, pp. 37-71, 1996.
[31] P. Sen, B. Chen, G. Garg, S. Marschner, M. Horowitz, M. Levoy, and H. Lensch, "Dual Photography," ACM Trans. Graphics, vol. 24, no. 3, pp. 745-755, 2005.
18 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool