Subscribe
Issue No.01 - January/February (2010 vol.16)
pp: 43-56
Ping-Man Lam , City University of Hong Kong, Hong Kong
Tze-Yiu Ho , City University of Hong Kong, Hong Kong
Chi-Sing Leung , City University of Hong Kong, Hong Kong
Tien-Tsin Wong , The Chinese University of Hong Kong, Hong Kong
ABSTRACT
This paper proposes a novel multiscale spherical radial basis function (MSRBF) representation for all-frequency lighting. It supports the illumination of distant environment as well as the local illumination commonly used in practical applications, such as games. The key is to define a multiscale and hierarchical structure of spherical radial basis functions (SRBFs) with basis functions uniformly distributed over the sphere. The basis functions are divided into multiple levels according to their coverage (widths). Within the same level, SRBFs have the same width. Larger width SRBFs are responsible for lower frequency lighting while the smaller width ones are responsible for the higher frequency lighting. Hence, our approach can achieve the true all-frequency lighting that is not achievable by the single-scale SRBF approach. Besides, the MSRBF approach is scalable as coarser rendering quality can be achieved without reestimating the coefficients from the raw data. With the homogeneous form of basis functions, the rendering is highly efficient. The practicability of the proposed method is demonstrated with real-time rendering and effective compression for tractable storage.
INDEX TERMS
Precomputed radiance transfer (PRT), multiscale spherical radial basis functions (MSRBFs), all-frequency rendering.
CITATION
Ping-Man Lam, Tze-Yiu Ho, Chi-Sing Leung, Tien-Tsin Wong, "All-Frequency Lighting with Multiscale Spherical Radial Basis Functions", IEEE Transactions on Visualization & Computer Graphics, vol.16, no. 1, pp. 43-56, January/February 2010, doi:10.1109/TVCG.2009.56
REFERENCES
 [1] J.T. Kajiya, “The Rendering Equation,” Computer Graphics, vol. 20, no. 4, pp. 143-150, 1986. [2] P. Bekaert, M. Sbert, and Y.D. Willems, “Weighted Importance Sampling Techniques for Monte Carlo Radiosity,” Proc. 11th Eurographics Workshop Rendering, B. Peroche and H. Rushmeier, eds., pp. 35-46, 2000. [3] J. Cohen and P. Debevec, LightGen HDRShop Plugin, 2001. [4] S. Agarwal, R. Ramamoorthi, S. Belongie, and H.W. Jensen, “Structured Importance Sampling of Environment Maps,” ACM Trans. Graphics, vol. 22, no. 3, pp. 605-612, 2003. [5] L. Wan, T.T. Wong, and C.S. Leung, “Spherical Q2-Tree for Sampling Dynamic Environment Sequences,” Proc. Eurographics Symp. Rendering, pp. 21-30, June 2005. [6] V. Ostromoukhov, C. Donohue, and P.-M. Jodoin, “Fast Hierarchical Importance Sampling with Blue Noise Properties,” ACM Trans. Graphics, vol. 23, no. 3, pp. 488-495, 2004. [7] B. Cabral, N. Max, and R. Springmeyer, “Bidirectional Reflection Functions from Surface Bump Maps,” Proc. ACM SIGGRAPH, vol. 21, pp. 273-281, July 1987. [8] P. Sloan, J. Kautz, and J. Snyder, “Precomputed Radiance Transfer for Real-Time Rendering in Dynamic, Low-Frequency Lighting Environments,” ACM Trans. Graphics, pp. 527-536, 2002. [9] P. Sloan, J. Hall, J. Hart, and J. Snyder, “Clustered Principal Components for Precomputed Radiance Transfer,” ACM Trans. Graphics, vol. 22, pp. 382-391, 2003. [10] J. Kautz, P. Sloan, and J. Snyder, “Fast, Arbitrary BRDF Shading for Low-Frequency Lighting Using Spherical Harmonics,” Proc. 13th Eurographics Workshop Rendering, pp. 291-297, 2002. [11] X. Liu, P.P. Sloan, H.Y. Shum, and J. Snyder, “All-Frequency Precomputed Radiance Transfer for Glossy Objects,” Proc. Eurographics Symp. Rendering, pp. 337-344, 2004. [12] A. Ben-Artzi, R. Overbeck, and R. Ramamoorthi, “Real-Time BRDF Editing in Complex Lighting,” Proc. ACM SIGGRAPH, pp.945-954, 2006. [13] R. Ramamoorthi and P. Hanrahan, “Frequency Space Environment Map Rendering,” Proc. ACM SIGGRAPH, pp. 517-526, 2002. [14] P. Schröder and W. Sweldens, “Spherical Wavelets: Efficiently Representing Functions on the Sphere,” Proc. ACM SIGGRAPH, pp. 161-172, 1995. [15] Z. Wang, C.S. Leung, Y.S. Zhu, and T.T. Wong, “Data Compression with Spherical Wavelets and Wavelets for the Image-Based Relighting,” Computer Vision and Image Understanding, vol. 96, pp.327-344, 2004. [16] R. Ng, R. Ramamoorthi, and P. Hanrahan, “All-Frequency Shadows Using Non-Linear Wavelet Lighting Approximation,” ACM Trans. Graphics, vol. 22, no. 3, pp. 376-381, 2003. [17] T.T. Wong, C.S. Leung, and K.H. Choy, “Lighting Precomputation Using the Relighting Map,” Shader $X^3$ , pp. 379-392, Charles River Media, 2004. [18] C.S. Leung, T.T. Wong, P.M. Lam, and K.H. Choy, “An RBF-Based Image Compression Method for Image-Based Rendering,” IEEE Trans. Image Processing, vol. 15, no. 4, pp. 1031-1041, Apr. 2006. [19] Y.-T. Tsai and Z.-C. Shih, “All-Frequency Precomputed Radiance Transfer Using Spherical Radial Basis Functions and Clustered Tensor Approximation,” ACM Trans. Graphics, vol. 25, no. 3, pp.967-976, 2006. [20] T.H. Li, “Multiscale Representation and Analysis of Spherical Data by Spherical Wavelets,” SIAM J. Scientific Computing, vol. 21, pp. 924-953, 1999. [21] T.H. Li, “Multiscale Wavelet Analysis of Scattered Spherical Data: Design and Estimation,” Environmetrics, vol. 12, pp. 179-202, 2001. [22] R. Wang, J. Tran, and D.P. Luebke, “All-Frequency Relighting of Non-Diffuse Objects Using Separable BRDF Approximation,” Proc. Eurographics Symp. Rendering, pp. 345-354, 2004. [23] M.A.O. Vasilescu and D. Terzopoulos, “Tensor Textures: Multilinear Image-Based Rendering,” ACM Trans. Graphics, vol. 23, pp.336-342, 2004. [24] P.-P. Sloan, X. Liu, H.-Y. Shum, and J. Snyder, “Bi-Scale Radiance Transfer,” ACM Trans. Graphics, vol. 22, no. 3, pp. 370-375, 2003. [25] R. Wang, J. Tran, and D. Luebke, “All-Frequency Relighting of Glossy Objects,” ACM Trans. Graphics, vol. 25, pp. 293-318, 2006. [26] W. Sun and A. Mukherjee, “Generalized Wavelet Product Integral for Rendering Dynamic Glossy Objects,” Proc. ACM SIGGRAPH, pp. 955-966, 2006. [27] P. Green, J. Kautz, W. Matusik, and F. Durand, “View-Dependent Precomputed Light Transport Using Nonlinear Gaussian Function Approximations” Proc. Symp. Interactive 3D Graphics and Games, pp. 7-14, Mar. 2006. [28] P. Green, J. Kautz, and F. Durand, “Efficient Reflectance and Visibility Approximations for Environment Map Rendering,” Proc. Eurographics, vol. 26, 2007. [29] C. Constantinopoulos and A. Likas, “An Incremental Training Method for the Probabilistic rbf Network,” IEEE Trans. Neural Networks, vol. 17, no. 4, pp. 966-974, July 2006. [30] F.J. Narcowich and J.D. Ward, “Nonstationary Wavelets on the m-Sphere for Scattered Data,” Applied and Computational Harmonic Analysis, vol. 3, pp. 324-336, 1996. [31] J. Ivanic and K. Ruedenberg, “Rotation Matrices for Real Spherical Harmonics. Direct Determination by Recursion,” J. Physical Chemistry, vol. 100, pp. 6342-6347, 1996. [32] J. Ivanic and K. Ruedenberg, “Additions and Corrections: Rotation Matrices for Real Spherical Harmonics. Direct Determination by Recursion,” J. Physical Chemistry, vol. 102, pp. 9099-9100, 1998. [33] R. Wang, R. Ng, D. Luebke, and G. Humphreys, “Efficient Wavelet Rotation for Environment Map Rendering,” Proc. Eurographics Symp. Rendering, 2006. [34] K.M. Górski, E. Hivon, and B.D. Wandelt, “Analysis Issues for Large CMB Data Sets,” Proc. MPA/ESO Conf. on Evolution of Large-Scale Structure: From Recombination to Garching, A.J. Banday, R.K.Sheth, and L. Da Costa, eds., Aug. 1998. [35] L. Pastor and A. Rodriguez, “Surface Approximation of 3D Objects from Irregularly Sampled Clouds of 3d Points Using Spherical Wavelets,” Proc. Int'l Conf. Image Analysis and Processing, pp. 70-75, 1999. [36] L. Wan, T.-T. Wong, and C.-S. Leung, “Isocube: Exploiting the Cubemap Hardware,” IEEE Trans. Visualization and Computer Graphics, vol. 13, no. 4, pp. 720-731, July/Aug. 2007. [37] J.L.O. Mark, “Regularization in the Selection of Radial Basis Function Centres,” Neural Computation, vol. 7, pp. 606-623, 1995. [38] P.M. Lam, C.S. Leung, and T.T. Wong, “Noise-Resistant Fitting for Spherical Harmonics,” IEEE Trans. Visualization and Computer Graphics, vol. 12, no. 2, pp. 254-265, Mar./Apr. 2006. [39] S.B. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, “High Dynamic Range Video,” Proc. ACM SIGGRAPH, pp. 319-325, 2003.