The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.11 - November (2009 vol.31)
pp: 1921-1940
Jiří Filip , Institute of Information Theory and Automation of the AS CR, Praha
Michal Haindl , Institute of Information Theory and Automation of the AS CR, Praha
ABSTRACT
An ever-growing number of real-world computer vision applications require classification, segmentation, retrieval, or realistic rendering of genuine materials. However, the appearance of real materials dramatically changes with illumination and viewing variations. Thus, the only reliable representation of material visual properties requires capturing of its reflectance in as wide range of light and camera position combinations as possible. This is a principle of the recent most advanced texture representation, the Bidirectional Texture Function (BTF). Multispectral BTF is a seven-dimensional function that depends on view and illumination directions as well as on planar texture coordinates. BTF is typically obtained by measurement of thousands of images covering many combinations of illumination and viewing angles. However, the large size of such measurements has prohibited their practical exploitation in any sensible application until recently. During the last few years, the first BTF measurement, compression, modeling, and rendering methods have emerged. In this paper, we categorize, critically survey, and psychophysically compare such approaches, which were published in this newly arising and important computer vision and graphics area.
INDEX TERMS
BTF, BRDF, 3D texture, surface texture, texture measurement, texture analysis, texture synthesis, texture modeling, data compression, psychophysical study, light transport.
CITATION
Jiří Filip, Michal Haindl, "Bidirectional Texture Function Modeling: A State of the Art Survey", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.31, no. 11, pp. 1921-1940, November 2009, doi:10.1109/TPAMI.2008.246
REFERENCES
[1] M. Ashikhmin, “Synthesizing Natural Textures,” Proc. ACM Symp. Interactive 3D Graphics, pp. 217-226, 2001.
[2] J. Bennett and A. Khotanzad, “Multispectral Random Field Models for Synthesis and Analysis of Color Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 3, pp. 327-332, Mar. 1998.
[3] J. Besag, “Spatial Interaction and the Statistical Analysis of Lattice Systems,” J. Royal Statistical Soc., vol. B-36, no. 2, pp. 192-236, Feb. 1974.
[4] Bonn University BTF Database, http:/btf.cs.uni-bonn.de, 2003.
[5] B. Caputo, E. Hayman, and P. Mallikarjuna, “Class-Specific Material Categorisation,” Proc. Int'l Conf. Computer Vision, pp.1597-1604, 2005.
[6] M. Cohen, J. Shade, and, S.E.A. Hiller, “Wang Tiles for Image and Texture Generation,” ACM Trans. Graphics, vol. 22, no. 3, pp. 287-294, July 2003.
[7] H.S.M. Coxeter, Introduction to Geometry. Wiley, 1969.
[8] O. Cula, K. Dana, F. Murphy, and, B. Rao, “Bidirectional Imaging and Modeling of Skin Texture,” IEEE Trans. Biomedical Eng., vol. 51, no. 12, pp. 2148-2159, Dec. 2004.
[9] S. Daly, “The Visible Differences Predictor: An Algorithm for the Assessment of Image Fidelity,” Digital Images and Human Vision, pp. 179-206, 1993.
[10] K.J. Dana, S.K. Nayar, B. van Ginneken, and J.J. Koenderink, “Reflectance and Texture of Real-World Surfaces,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 151-157, 1997.
[11] K. Dana, B. van Ginneken, S. Nayar, and J. Koenderink, “Reflectance and Texture of Real-World Surfaces,” ACM Trans. Graphics, vol. 18, no. 1, pp. 1-34, 1999.
[12] K. Dana and J. Wang, “Device for Convenient Measurement of Spatially Varying Bidirectional Reflectance,” J. Optical Soc. America, vol. 21, no. 1, pp. 1-12, 2004.
[13] K. Daubert, H.P.A. Lensch, W. Heidrich, and H.-P. Seidel, “Efficient Cloth Modeling and Rendering,” Proc. Conf. Rendering Techniques, pp. 63-70, 2001.
[14] J. De Bonet, “Multiresolution Sampling Procedure for Analysis and Synthesis of Textured Images,” Proc. ACM SIGGRAPH, pp.361-368, 1997.
[15] P. Debevec, T. Hawkins, C. Tchou, H.-P. Duiker, W. Sarokin, and M. Sagar, “Acquiring the Reflectance Field of A Human Face,” Proc. ACM SIGGRAPH, pp. 145-156, July 2000.
[16] J. Dong and M. Chantler, “Comparison of Five 3D Surface Texture Synthesis Methods,” Proc. Third Int'l Workshop Texture Analysis and Synthesis, pp. 19-23, 2003.
[17] J. Dong and M. Chantler, “Capture and Synthesis of 3D Surface Texture,” Int'l J. Computer Vision, vol. 62, nos. 1/2, pp. 177-194, Apr. 2005.
[18] A.A. Efros and W.T. Freeman, “Image Quilting for Texture Synthesis and Transfer,” Proc. ACM SIGGRAPH, pp. 341-346, 2001.
[19] A.A. Efros and T.K. Leung, “Texture Synthesis by Non-Parametric Sampling,” Proc. Int'l Conf. Computer Vision, vol. 2, pp.1033-1038, 1999.
[20] R. Fernando, M. Harris, M. Wloka, and C. Zeller, “Programming Graphics Hardware,” Proc. Computer Graphics Forum, Aug. 2004.
[21] J. Filip, M. Chantler, P. Green, and M. Haindl, “A Psychophysically Validated Metric for Bidirectional Texture Data Reduction,” ACM Trans. Graphics, vol. 27, no. 5, Dec. 2008.
[22] J. Filip, M. Chantler, and M. Haindl, “On Optimal Resampling of View and Illumination Dependent Textures,” Proc. Fifth Symp. Applied Perception in Graphics and Visualization, pp. 131-134, Aug. 2008.
[23] J. Filip and M. Haindl, “Non-Linear Reflectance Model for Bidirectional Texture Function Synthesis,” Proc. 17th Int'l Assoc. for Pattern Recognition Int'l Conf. Pattern Recognition, vol. 1, pp. 80-83, Aug. 2004.
[24] J. Filip and M. Haindl, “Efficient Image-Based Bidirectional Texture Function Model,” Proc. Fourth Int'l Workshop Texture Analysis and Synthesis, pp. 7-12, Oct. 2005.
[25] J. Filip and M. Haindl, “BTF Modelling Using BRDF Texels,” Int'l J. Computer Math., vol. 84, no. 9, pp. 1267-1283, Sept. 2007.
[26] R. Furukawa, H. Kawasaki, K. Ikeuchi, and M. Sakauchi, “Appearance Based Object Modeling Using Texture Database: Acquisition, Compression and Rendering,” Proc. 13th Eurographics Workshop Rendering, pp. 257-266, 2002.
[27] J. Grim and M. Haindl, “Texture Modelling by Discrete Distribution Mixtures,” Computational Statistics Data Analysis, vol. 41, nos.3/4, pp. 603-615, Jan. 2003.
[28] M. Haindl, “Texture Synthesis,” CWI Quarterly, vol. 4, no. 4, pp.305-331, Dec. 1991.
[29] M. Haindl and J. Filip, “Fast BTF Texture Modelling,” Proc. Third Int'l Workshop Texture Analysis and Synthesis, Oct. 2003.
[30] M. Haindl and J. Filip, “A Fast Probabilistic Bidirectional Texture Function Model,” Lecture Notes in Computer Science, vol. 3212, pp.298-305, Springer, 2004.
[31] M. Haindl and J. Filip, “Extreme Compression and Modeling of Bidirectional Texture Function,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 10, pp. 1859-1865, Oct. 2007.
[32] M. Haindl, J. Filip, and M. Arnold, “BTF Image Space Utmost Compression and Modelling Method,” Proc. Seventh Int'l Assoc. for Pattern Recognition Int'l Conf. Pattern Recognition, vol. 3, pp.194-197, Aug. 2004.
[33] M. Haindl, J. Grim, P. Pudil, and K.M., “A Hybrid BTF Model Based on Gaussian Mixtures,” Proc. Fourth Int'l Workshop Texture Analysis and Synthesis, pp. 95-100, Oct. 2005.
[34] M. Haindl, J. Grim, P. Somol, P. Pudil, and M. Kudo, “A Gaussian Mixture-Based Colour Texture Model,” Proc. 17th Int'l Assoc. for Pattern Recognition Int'l Conf. Pattern Recognition, vol. 3, pp.177-180, Aug. 2004.
[35] M. Haindl and M. Hatka, “A Roller—Fast Sampling-Based Texture Synthesis Algorithm,” Proc. Int'l Conf. Central Europe Computer Graphics, Visualization and Computer Vision, pp. 80-83, Jan. 2005.
[36] M. Haindl and M. Hatka, “BTF Roller,” Proc. Fourth Int'l Workshop Texture Analysis and Synthesis, pp. 89-94, Oct. 2005.
[37] M. Haindl and V. Havlíček, “A Multiresolution Causal Colour Texture Model,” Advances in Pattern Recognition, chap. 1, pp. 114-122, Springer-Verlag, Aug. 2000.
[38] M. Haindl and P. Vácha, “Illumination Invariant Texture Retrieval,” Proc. 18th Int'l Conf. Pattern Recognition, pp. 276-279, Aug. 2006.
[39] J.Y. Han and K. Perlin, “Measuring Bidirectional Texture Reflectance with a Kaleidoscope,” ACM Trans. Graphics, vol. 22, no. 3, pp. 741-748, 2003.
[40] E. Hayman, B. Caputo, M. Fritz, and J. Eklundh, “On the Significance of Real-World Conditions for Material Classification,” Proc. Eighth European Conf. Computer Vision, pp. 253-266, 2004.
[41] D. Heeger and J. Bergen, “Pyramid Based Texture Analysis/Synthesis,” Proc. ACM SIGGRAPH, pp. 229-238, 1995.
[42] P.-M. Ho, T.-T. Wong, and C.-S. Leung, “Compressing the Illumination-Adjustable Images with Principal Component Analysis,” IEEE Trans. Circuits and Systems for Video Technology, vol. 15, no. 3, pp. 355-364, Mar. 2005.
[43] B. Julesz, “Visual Pattern Discrimination,” IRE Trans. Information Theory, vol. 8, no. 1, pp. 84-92, Feb. 1962.
[44] B. Julesz, “Textons, the Elements of Texture Perception and Their Interactions,” Nature, vol. 290, pp. 91-97, 1981.
[45] B. Julesz, E. Gilbert, and J. Victor, “Visual Discrimination of Textures with Identical Third-Order Statistics,” Biological Cybernetics, vol. 31, pp. 137-140, 1978.
[46] R. Kashyap, “Analysis and Synthesis of Image Patterns by Spatial Interaction Models,” Progress in Pattern Recognition, vol. 1, pp. 149-186, Elsevier, 1981.
[47] J. Kautz, S. Boulos, and F. Durand, “Interactive Editing and Modelling of Bidirectional Texture Functions,” ACM Trans. Graphics, vol. 26, no. 3, p. 53, 2007.
[48] J. Kautz, M. Sattler, R. Sarlette, R. Klein, and H.-P. Seidel, “Decoupling BRDFs from Surface Mesostructures,” Proc. Graphics Interface Conf. '04, pp. 177-184, 2004.
[49] H. Kawasaki, K.-D. Seo, Y. Ohsawa, and R. Furukawa, “Patch-Based BTF Synthesis for Real-Time Rendering,” Proc. IEEE Int'l Conf. Image Processing, vol. 1, pp. 393-396, Sept. 2005.
[50] M. Koudelka, S. Magda, P. Belhumeur, and D. Kriegman, “Acquisition, Compression, and Synthesis of Bidirectional Texture Functions,” Proc. Third Int'l Workshop Texture Analysis and Synthesis, pp. 47-52, Oct. 2003.
[51] V. Kwatra, A. Schodl, I. Essa, G. Turk, and A. Bobick, “Graphcut Textures: Image and Video Synthesis Using Graph Cuts,” ACM Trans. Graphics, vol. 22, no. 3 pp. 277-286, July 2003.
[52] E.P. Lafortune, S.C. Foo, K.E. Torrance, and D.P. Greenberg, “Non-Linear Approximation of Reflectance Functions,” Computer Graphics, vol. 31, pp. 117-126, 1997.
[53] J. Lawrence, A. Ben-Artzi, C. DeCoro, W. Matusik, H. Pfister, R. Ramamoorthi, and S. Rusinkiewicz, “Inverse Shade Trees for Non-Parametric Material Representation and Editing,” ACM Trans. Graphics, vol. 25, no. 3, pp. 735-745, 2006.
[54] J. Lehtinen, “A Framework for Precomputed and Captured Light Transport,” ACM Trans. Graphics, vol. 26, no. 4, pp. 13:1-13:22, 2007.
[55] C.-S. Leung, W.-M. Pang, C.-W. Fu, T.-T. Wong, and P.-A. Heng, “Tileable BTF,” IEEE Trans. Visualization and Computer Graphics, vol. 13, no. 5, pp. 935-955, Sept./Oct. 2007.
[56] C.-S. Leung, T.-T. Wong, P.-M. Lam, and K.-H. Choy, “An RBF-Based Compression Method for Image-Based Relighting,” IEEE Trans. Image Processing, vol. 15, no. 4, pp. 1031-1041, Apr. 2006.
[57] T. Leung and J. Malik, “Representing and Recognizing the Visual Appearance of Materials Using Three-Dimensional Textons,” Int'l J. Computer Vision, vol. 43, no. 1, pp. 29-44, 2001.
[58] X. Liu, Y. Yu, and H.Y. Shum, “Synthesizing Bidirectional Texture Functions for Real-World Surfaces,” Proc. ACM SIGGRAPH, pp.97-106, 2001.
[59] X. Liu, J. Zhang, X. Tong, B. Guo, and H.-Y. Shum, “Synthesis and Rendering of Bidirectional Texture Functions on Arbitrary Surfaces,” IEEE Trans. Visualization and Computer Graphics, vol. 10, no. 3, pp. 278-289, May/June 2004.
[60] W.-C. Ma, S.-H. Chao, B.-Y. Chen, C.-F. Chang, M. Ouhyoung, and T. Nishita, “An Efficient Representation of Complex Materials for Real-Time Rendering,” Proc. ACM Symp. Virtual Reality Software and Technology, pp. 150-153, 2004.
[61] W.-C. Ma, S.-H. Chao, Y.-T. Tseng, Y.-Y. Chuang, C.-F. Chang, B.-Y. Chen, and M. Ouhyoung, “Level-of-Detail Representation of Bidirectional Texture Functions for Real-Time Rendering,” Proc. 2005 Symp. Interactive 3D Graphics, pp. 187-194, Apr. 2005.
[62] S. Magda and D. Kriegman, “Reconstruction of Volumetric Surface Textures for Real-Time Rendering,” Proc. 17th Eurographics Workshop Rendering, pp. 19-29, June 2006.
[63] T. Malzbender, D. Gelb, and H. Wolters, “Polynomial Texture Maps,” Proc. ACM SIGGRAPH, pp. 519-528, 2001.
[64] S. Marschner, S. Westin, A. Arbree, and J. Moon, “Measuring and Modeling the Appearance of Finished Wood,” ACM Trans. Graphics, vol. 24, no. 3, pp. 727-734, 2005.
[65] D.K. McAllister, A. Lastra, and W. Heidrich, “Efficient Rendering of Spatial Bi-Directional Reflectance Distribution Functions,” Graphics Hardware, pp. 77-88, 2002.
[66] M. McCool, J. Ang, and A. Ahmad, “Homomorphic Factorization of BRDFs for High-Performance Rendering,” Proc. ACM SIGGRAPH, pp. 185-194, 2001.
[67] J. Meseth, G. Müller, and R. Klein, “Preserving Realism in Real-Time Rendering of Bidirectional Texture Functions,” Proc. OpenSG Symp., pp. 89-96, Apr. 2003.
[68] J. Meseth, G. Müller, R. Klein, F. Röder, and M. Arnold, “Verification of Rendering Quality from Measured BTFs,” Proc. Third Symp. Applied Perception in Graphics and Visualization, vol. 153, pp. 127-134, July 2006.
[69] J. Meseth, G. Müller, M. Sattler, and R. Klein, “BTF Rendering for Virtual Environments,” Proc. Conf. Virtual Concepts 2003, pp. 356-363, Nov. 2003.
[70] G. Müller, G. Bendels, and R. Klein, “Rapid Synchronous Acquisition of Geometry and BTF for Cultural Heritage Artefacts,” Proc. Sixth Int'l Symp. Virtual Reality, Archaeology and Cultural Heritage, pp. 13-20, 2005.
[71] G. Müller, J. Meseth, and R. Klein, “Compression and Real-Time Rendering of Measured BTFs Using Local PCA,” Proc. Conf. Vision, Modeling, and Visualisation, pp. 271-280, Nov. 2003.
[72] G. Müller, J. Meseth, M. Sattler, R. Sarlette, and R. Klein, “Acquisition, Synthesis and Rendering of Bidirectional Texture Functions,” Proc. Eurographics 2004 State of the Art Reports, pp. 69-94, Sept. 2004.
[73] A. Neubeck, A. Zalesny, and L. Gool, “3D Texture Reconstruction from Extensive BTF Data,” Proc. Fourth Int'l Workshop Texture Analysis and Synthesis, pp. 13-18, Oct. 2005.
[74] A. Neubeck, A. Zalesny, and L. Van Gool, “Viewpoint Consistent Texture Synthesis,” Proc. Conf. 3D Data Processing, Visualization and Transmission, pp. 388-395, Sept. 2004.
[75] A. Ngan and F. Durand, “Statistical Acquisition of Texture Appearance,” Proc. Eurographics Symp. Rendering '05, pp. 31-40, Aug. 2006.
[76] F. Nicodemus, R.J.C.J. Hsia, I. Ginsburg, and T. Limperis, “Geometrical Considerations and Nomenclature for Reflectance,” NBS Monograph 160, Nat'l Bureau of Standards, US Dept. of Commerce, pp. 1-52, 1977.
[77] F. Pellacini and J. Lawrence, “AppWand: Editing Measured Materials Using Appearance-Driven Optimization,” ACM Trans. Graphics, vol. 26, no. 3, pp. 54:1-54:10, 2007.
[78] S.C. Pont and J.J. Koenderink, “Bidirectional Texture Contrast Function,” Int'l J. Computer Vision, vol. 62, nos. 1/2, pp. 17-34, 2005.
[79] R. Ramamoorthi, M. Koudelka, and P. Belhumeur, “A Fourier Theory for Cast Shadows,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 2, pp. 288-295, Feb. 2005.
[80] M. Sattler, R. Sarlette, and R. Klein, “Efficient and Realistic Visualization of Cloth,” Proc. Eurographics Symp. Rendering, pp.167-178, June 2003.
[81] P. Somol and M. Haindl, “Novel Path Search Algorithm for Image Stitching and Advanced Texture Tiling,” Proc. 13th Int'l Conf. in Central Europe on Computer Graphics, Visualization and Computer Vision, pp. 155-162, 2005.
[82] P. Suen and G. Healey, “The Analysis and Recognition of Real-World Textures in Three Dimensions,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 5, pp. 491-503, May 2000.
[83] F. Suykens, K. Berge, A. Lagae, and P. Dutré, “Interactive Rendering with Bidirectional Texture Functions,” Computer Graphics Forum, vol. 22, no. 3, pp. 463-472, Sept. 2003.
[84] X. Tong, J. Zhang, L. Liu, B. Wang, X. Guo, and H.-Y. Shum, “Synthesis of Bidirectional Texture Functions on Arbitrary Surfaces,” Proc. ACM SIGGRAPH, pp. 665-672, 2002.
[85] P. Vacha and M. Haindl, “Image Retrieval Measures Based on Illumination Invariant Textural MRF Features,” Proc. Sixth ACM Int'l Conf. Image and Video Retrieval, pp. 448-454, 2007.
[86] M. Vasilescu and D. Terzopoulos, “Tensor Textures: Multilinear Image-Based Rendering,” Proc. ACM SIGGRAPH, vol. 23, no. 3 pp.336-342, Aug. 2004.
[87] H. Wang, G. Wu, L. Shi, Y. Yu, and N. Ahuja, “Out-of-Core Tensor Approximation of Multi-Dimensional Matrices of Visual Data,” ACM Trans. Graphics, vol. 24, no. 3, pp. 527-535, July 2005.
[88] J. Wang and K. Dana, “Hybrid Textons: Modeling Surfaces with Reflectance and Geometry,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 372-378, 2004.
[89] J. Wang and K. Dana, “Relief Texture from Specularities,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 3, pp.446-457, Mar. 2006.
[90] J. Wang, X. Tong, J. Snyder, Y. Chen, B. Guo, and H.-Y. Shum, “Capturing and Rendering Geometry Details for BTF-Mapped Surfaces,” The Visual Computer, vol. 21, nos. 8-10, pp. 559-568, 2005.
[91] L. Wei and M. Levoy, “Texture Synthesis over Arbitrary Manifold Surfaces,” Proc. ACM SIGGRAPH, pp. 355-360, 2001.
[92] F. Wichmann and N. Hill, “The Psychometric Function: I. Fitting, Sampling, and Goodness of Fit,” Perception & Psychophysics, vol. 63, no. 8, pp. 1293-1313, 2001.
[93] T.-T. Wong and C.-S. Leung, “Compression of Illumination-Adjustable Images,” IEEE Trans. Circuits and Systems for Video Technology, vol. 13, no. 11, pp. 1107-1118, Nov. 2003.
[94] Y. Xu, B. Guo, and H. Shum, “Chaos Mosaic: Fast and Memory Efficient Texture Synthesis,” Technical Report MSR-TR-2000-32, Microsoft Research, 2000.
[95] H. Yacov, T. Malzbender, and D. Gelb, “Synthesis of Reflectance Function Textures from Examples,” Proc. Third Int'l Workshop Texture Analysis and Synthesis, pp. 47-52, Oct. 2003.
[96] J. Yellott, “Implications of Triple Correlation Uniqueness for Texture Statistics and the Julesz Conjecture,” J. Optical Soc. Am., vol. 10, no. 5 pp. 777-793, May 1993.
[97] S. Zelinka and M. Garland, “Interactive Texture Synthesis on Surfaces Using Jump Maps,” Proc. 14th Eurographics Workshop Rendering, pp. 90-96, 2003.
[98] J. Zhang, D. Wang, and G. Tran, “A Wavelet-Based Multiresolution Statistical Model for Texture,” IEEE Trans. Image Processing, vol. 7, no. 11, pp. 1621-1627, Nov. 1998.
[99] K. Zhou, P. Du, L. Wang, Y. Matsushita, J. Shi, B. Guo, and H.-Y. Shum, “Decorating Surfaces with Bidirectional Texture Functions,” IEEE Trans. Visualization and Computer Graphics, vol. 11, no. 5, pp. 519-528, Sept./Oct. 2005.
[100] S. Zhu, X. Liu, and Y. Wu, “Exploring Texture Ensembles by Efficient Markov Chain Monte Carlo—Toward A “Trichromacy” Theory of Texture,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 6, pp. 554-569, June 2000.
6 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool