| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Rendering Deformable Surface Reflectance Fields
January/February 2005 (vol. 11 no. 1)
pp. 48-58
Animation of photorealistic computer graphics models is an important goal for many applications. Image-based modeling has emerged as a promising approach to capture and visualize real-world objects. Animating image-based models, however, is still a largely unsolved problem. In this paper, we extend a popular image-based representation called surface reflectance field to animate and render deformable real-world objects under arbitrary illumination. Deforming the surface reflectance field is achieved by modifying the underlying impostor geometry. We augment the impostor by a local parameterization that allows the correct evaluation of acquired reflectance images, preserving the original light model on the deformed surface. We present a deferred shading scheme to handle the increased amount of data involved in shading the deformable surface reflectance field. We show animations of various objects that were acquired with 3D photography.
[1] 48 S.L. Altman, “Hamilton, Grassmann, Rodrigues, and the Quaternion Scandal— What Went Wrong with One of the Major Mathematical Discoveries of the Nineteenth Century?” A Math. Assoc. Am. J., Dec. 1989.[2] C. Buehler, M. Bosse, L. McMillan, S. Gortler, and M. Cohen, “Unstructured Lumigraph Rendering,” Computer Graphics, SIGGRAPH 2001 Proc., pp. 425-432, 2001.[3] W.-C. Chen, J.-Y. Bouguet, M.H. Chu, and R. Grzeszczuk, “Light Field Mapping: Efficient Representation and Hardware Rendering of Surface Light Fields,” ACM Trans. Graphics, vol. 21, no. 3, pp. 447-456, July 2002.[4] K.J. Dana, B. van Ginneken, S.K. Nayar, and J.J. Koenderink, “Reflectance and Texture of Real World Surfaces,” ACM Trans. Graphics, vol. 1, no. 18, pp. 1-34, 1999.[5] P. Debevec, T. Hawkins, C. Tchou, H.-P. Duiker, W. Sarokin, and M. Sagar, “Acquiring the Reflectance Field of a Human Face,” Computer Graphics, SIGGRAPH 2000 Proc., pp. 145-156, July 2000.[6] P. Debevec and J. Malik, “Recovering High Dynamic Range Radiance Maps from Photographs,” Computer Graphics SIGGRAPH '97 Proc., pp. 369-378, 1997.[7] P. Debevec, C. Taylor, and J. Malik, “Modeling and Rendering Architecture from Photographs: A Hybrid Geometry- and Image-Based Approach,” Computer Graphics SIGGRAPH '96 Proc., pp. 11-20, Aug. 1996.[8] P. Debevec, Y. Yu, and G. Borshukov, “Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping,” Proc. Ninth Eurographics Workshop Rendering, pp. 105-116, June 1998.[9] R. Furukawa, H. Kawasaki, K. Ikeuchi, and M. Sakauchi, “Appearance Based Object Modeling Using Texture Database: Acquisition, Compression and Rendering,” Proc. 13th Eurographics Workshop Rendering, June 2002.[10] S. Gortler, R. Grzeszczuk, R. Szeliski, and M. Cohen, “The Lumigraph,” Computer Graphics SIGGRAPH '96 Proc., pp. 43-54, Aug. 1996.[11] T. Hawkins, J. Cohen, and P. Debevec, “A Photometric Approach to Digitizing Cultural Artifacts,” Proc. Second Int'l Symp. Virtual Reality, Archaeology, and Cultural Heritage, Nov. 2001.[12] P. Heckbert, “Fundamentals of Texture Mapping and Image Warping,” master's thesis, Dept. of Electrical Eng. and Computer Science, Univ. of California, Berkeley, June 1989.[13] W. Heidrich and H.-P. Seidel, “Realistic, Hardware-Accelerated Shading and Lighting,” Computer Graphics SIGGRAPH '99 Proc., pp. 171-178, Aug. 1999.[14] J. Kautz and M. McCool, “Interactive Rendering with Arbitrary Brdfs Using Separable Approximations,” Proc. Rendering Techniques '99 (Proc. 10th Eurographics Workshop Rendering), pp. 281-292, June 1999.[15] M. Koudelka, P. Belhumeur, S. Magda, and D. Kriegman, “Image-Based Modeling and Rendering of Surfaces with Arbitrary BRDFs,” Proc. Computer Vision and Pattern Recognition, Dec. 2001.[16] H. Lensch, J. Kautz, M. Goesele, W. Heidrich, and H.-P. Seidel, “Image-Based Reconstruction of Spatially Varying Materials,” Proc. 12th Eurographics Workshop Rendering, pp. 104-115, June 2001.[17] M. Levoy and P. Hanrahan, “Light Field Rendering,” Computer Graphics SIGGRAPH '96 Proc., pp. 31-42, Aug. 1996.[18] T. Malzbender, D. Gelb, and H. Wolters, “Polynomial Texture Maps,” Computer Graphics SIGGRAPH 2001 Proc., pp. 519-528, 2001.[19] S. Marschner, S. Westin, E. Lafortune, and K. Torrance, “Image-Based Measurement of the Bidirectional Reflectance Distribution Function,” Applied Optics, vol. 39, no. 16, 2000.[20] W. Matusik, H. Pfister, A. Ngan, P. Beardsley, R. Ziegler, and L. McMillan, “Image-Based 3D Photography Using Opacity Hulls,” ACM Trans. Graphics, vol. 21, no. 3, pp. 427-437, July 2002.[21] W. Matusik, H. Pfister, R. Ziegler, A. Ngan, and L. McMillan, “Acquisition and Rendering of Transparent and Refractive Objects,” Proc. 13th Eurographics Workshop Rendering, June 2002.[22] M. McCool, J. Ang, and A. Ahmad, “Homomorphic Factorization of BRDFs for High-Performance Rendering,” Computer Graphics, vol. 35, pp. 171-178, 2001.[23] G. Miller, S. Rubin, and D. Ponceleon, “Lazy Decompression of Surface Light Fields for Precomputed Global Illumination,” Proc. Ninth Eurographics Workshop Rendering, pp. 281-292, June 1998.[24] K. Nishino, Y. Sato, and K. Ikeuchi, “Appearance Compression and Synthesis Based on 3D Model for Mixed Reality,” Proc. IEEE Int'l Conf. Computer Vision (ICCV '99), pp. 38-45, Sept. 1999.[25] K. Nishino, Y. Sato, and K. Ikeuchi, “Eigen-Texture Method: Appearance Compression Based on 3D Model,” Proc. Computer Vision and Pattern Recognition, pp. 618-624, June 1999.[26] H. Pfister, M. Zwicker, J. van Baar, and M. Gross, “Surfels: Surface Elements as Rendering Primitives,” Computer Graphics, SIGGRAPH 2000 Proc., pp. 335-342, July 2000.[27] K. Pulli, M. Cohen, T. Duchamp, H. Hoppe, L. Shapiro, and W. Stuetzle, “View-Based Rendering: Visualizing Real Objects from Scanned Range and Color Data,” Proc. Eurographics Rendering Workshop 1997, pp. 23-34, June 1997.[28] Y. Sato, M.D. Wheeler, and K. Ikeuchi, “Object Shape and Reflectance Modeling from Observation,” Computer Graphics, SIGGRAPH '97 Proc., pp. 379-387, 1997.[29] D. Vlasic, H. Pfister, S. Molinov, R. Grzeszczuk, and W. Matusik, “Opacity Light Fields: Interactive Rendering of Surface Light Fields with View-Dependent Opacity,” Proc. Interactive 3D Graphics Symp. 2003, 2003.[30] G. Ward, “Measuring and Modeling Anisotropic Reflection,” Computer Graphics, vol. 26, pp. 265-273, 1992.[31] D. Wood, D. Azuma, K. Aldinger, B. Curless, T. Duchamp, D. Salesin, and W. Stuetzle, “Surface Light Fields for 3D Photography,” Computer Graphics, SIGGRAPH 2000 Proc., pp. 287-296, July 2000.[32] Y. Yu, P. Debevec, J. Malik, and T. Hawkins, “Inverse Global Illumination: Recovering Reflectance Models of Real Scenes from Photographs,” Computer Graphics, SIGGRAPH '99 Proc., pp. 215-224, Aug. 1999.[33] Z. Zhang, L. Wang, B. Guo, and H.-Y. Shum, “Feature-Based Light Field Morphing,” Computer Graphics, SIGGRAPH 2002 Proc., pp. 457-464, July 2002.[34] M. Zwicker, M. Pauly, O. Knoll, and M. Gross, “Pointshop 3D: An Interactive System for Point-Based Surface Editing,” Computer Graphics, SIGGRAPH 2002 Proc., pp. 322-329, July 2002.[35] M. Zwicker, H. Pfister, J. Van Baar, and M. Gross, “Surface Splatting,” Computer Graphics, SIGGRAPH 2001 Proc., pp. 371-378, July 2001.[36] M. Zwicker, H. Pfister, J. Van Baar, and M. Gross, “EWA Splatting,” IEEE Trans. Visualization and Computer Graphics, vol. 8, no. 3, pp. 223-238, July-Sept. 2002.
Index Terms:
Computer graphics, image-based rendering.
Citation:
Tim Weyrich, Hanspeter Pfister, Markus Gross, "Rendering Deformable Surface Reflectance Fields," IEEE Transactions on Visualization and Computer Graphics, vol. 11, no. 1, pp. 48-58, Jan./Feb. 2005, doi:10.1109/TVCG.2005.14
