CSDL Home IEEE Transactions on Pattern Analysis & Machine Intelligence 2009 vol.31 Issue No.11 - November

Subscribe

Issue No.11 - November (2009 vol.31)

pp: 1921-1940

Jiří Filip , Institute of Information Theory and Automation of the AS CR, Praha

ABSTRACT

An ever-growing number of real-world computer vision applications require classification, segmentation, retrieval, or realistic rendering of genuine materials. However, the appearance of real materials dramatically changes with illumination and viewing variations. Thus, the only reliable representation of material visual properties requires capturing of its reflectance in as wide range of light and camera position combinations as possible. This is a principle of the recent most advanced texture representation, the Bidirectional Texture Function (BTF). Multispectral BTF is a seven-dimensional function that depends on view and illumination directions as well as on planar texture coordinates. BTF is typically obtained by measurement of thousands of images covering many combinations of illumination and viewing angles. However, the large size of such measurements has prohibited their practical exploitation in any sensible application until recently. During the last few years, the first BTF measurement, compression, modeling, and rendering methods have emerged. In this paper, we categorize, critically survey, and psychophysically compare such approaches, which were published in this newly arising and important computer vision and graphics area.

INDEX TERMS

BTF, BRDF, 3D texture, surface texture, texture measurement, texture analysis, texture synthesis, texture modeling, data compression, psychophysical study, light transport.

CITATION

Jiří Filip, "Bidirectional Texture Function Modeling: A State of the Art Survey",

*IEEE Transactions on Pattern Analysis & Machine Intelligence*, vol.31, no. 11, pp. 1921-1940, November 2009, doi:10.1109/TPAMI.2008.246REFERENCES

- [1] M. Ashikhmin, “Synthesizing Natural Textures,”
Proc. ACM Symp. Interactive 3D Graphics, pp. 217-226, 2001.- [3] J. Besag, “Spatial Interaction and the Statistical Analysis of Lattice Systems,”
J. Royal Statistical Soc., vol. B-36, no. 2, pp. 192-236, Feb. 1974.- [4] Bonn University BTF Database, http:/btf.cs.uni-bonn.de, 2003.
- [5] B. Caputo, E. Hayman, and P. Mallikarjuna, “Class-Specific Material Categorisation,”
Proc. Int'l Conf. Computer Vision, pp.1597-1604, 2005.- [7] H.S.M. Coxeter,
Introduction to Geometry. Wiley, 1969.- [9] S. Daly, “The Visible Differences Predictor: An Algorithm for the Assessment of Image Fidelity,”
Digital Images and Human Vision, pp. 179-206, 1993.- [13] K. Daubert, H.P.A. Lensch, W. Heidrich, and H.-P. Seidel, “Efficient Cloth Modeling and Rendering,”
Proc. Conf. Rendering Techniques, pp. 63-70, 2001.- [14] J. De Bonet, “Multiresolution Sampling Procedure for Analysis and Synthesis of Textured Images,”
Proc. ACM SIGGRAPH, pp.361-368, 1997.- [15] P. Debevec, T. Hawkins, C. Tchou, H.-P. Duiker, W. Sarokin, and M. Sagar, “Acquiring the Reflectance Field of A Human Face,”
Proc. ACM SIGGRAPH, pp. 145-156, July 2000.- [16] J. Dong and M. Chantler, “Comparison of Five 3D Surface Texture Synthesis Methods,”
Proc. Third Int'l Workshop Texture Analysis and Synthesis, pp. 19-23, 2003.- [17] J. Dong and M. Chantler, “Capture and Synthesis of 3D Surface Texture,”
Int'l J. Computer Vision, vol. 62, nos. 1/2, pp. 177-194, Apr. 2005.- [18] A.A. Efros and W.T. Freeman, “Image Quilting for Texture Synthesis and Transfer,”
Proc. ACM SIGGRAPH, pp. 341-346, 2001.- [20] R. Fernando, M. Harris, M. Wloka, and C. Zeller, “Programming Graphics Hardware,”
Proc. Computer Graphics Forum, Aug. 2004.- [21] J. Filip, M. Chantler, P. Green, and M. Haindl, “A Psychophysically Validated Metric for Bidirectional Texture Data Reduction,”
ACM Trans. Graphics, vol. 27, no. 5, Dec. 2008.- [22] J. Filip, M. Chantler, and M. Haindl, “On Optimal Resampling of View and Illumination Dependent Textures,”
Proc. Fifth Symp. Applied Perception in Graphics and Visualization, pp. 131-134, Aug. 2008.- [23] J. Filip and M. Haindl, “Non-Linear Reflectance Model for Bidirectional Texture Function Synthesis,”
Proc. 17th Int'l Assoc. for Pattern Recognition Int'l Conf. Pattern Recognition, vol. 1, pp. 80-83, Aug. 2004.- [24] J. Filip and M. Haindl, “Efficient Image-Based Bidirectional Texture Function Model,”
Proc. Fourth Int'l Workshop Texture Analysis and Synthesis, pp. 7-12, Oct. 2005.- [26] R. Furukawa, H. Kawasaki, K. Ikeuchi, and M. Sakauchi, “Appearance Based Object Modeling Using Texture Database: Acquisition, Compression and Rendering,”
Proc. 13th Eurographics Workshop Rendering, pp. 257-266, 2002.- [28] M. Haindl, “Texture Synthesis,”
CWI Quarterly, vol. 4, no. 4, pp.305-331, Dec. 1991.- [29] M. Haindl and J. Filip, “Fast BTF Texture Modelling,”
Proc. Third Int'l Workshop Texture Analysis and Synthesis, Oct. 2003.- [30] M. Haindl and J. Filip, “A Fast Probabilistic Bidirectional Texture Function Model,”
Lecture Notes in Computer Science, vol. 3212, pp.298-305, Springer, 2004.- [31] M. Haindl and J. Filip, “Extreme Compression and Modeling of Bidirectional Texture Function,”
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 10, pp. 1859-1865, Oct. 2007.- [32] M. Haindl, J. Filip, and M. Arnold, “BTF Image Space Utmost Compression and Modelling Method,”
Proc. Seventh Int'l Assoc. for Pattern Recognition Int'l Conf. Pattern Recognition, vol. 3, pp.194-197, Aug. 2004.- [33] M. Haindl, J. Grim, P. Pudil, and K.M., “A Hybrid BTF Model Based on Gaussian Mixtures,”
Proc. Fourth Int'l Workshop Texture Analysis and Synthesis, pp. 95-100, Oct. 2005.- [34] M. Haindl, J. Grim, P. Somol, P. Pudil, and M. Kudo, “A Gaussian Mixture-Based Colour Texture Model,”
Proc. 17th Int'l Assoc. for Pattern Recognition Int'l Conf. Pattern Recognition, vol. 3, pp.177-180, Aug. 2004.- [35] M. Haindl and M. Hatka, “A Roller—Fast Sampling-Based Texture Synthesis Algorithm,”
Proc. Int'l Conf. Central Europe Computer Graphics, Visualization and Computer Vision, pp. 80-83, Jan. 2005.- [36] M. Haindl and M. Hatka, “BTF Roller,”
Proc. Fourth Int'l Workshop Texture Analysis and Synthesis, pp. 89-94, Oct. 2005.- [37] M. Haindl and V. Havlíček, “A Multiresolution Causal Colour Texture Model,”
Advances in Pattern Recognition, chap. 1, pp. 114-122, Springer-Verlag, Aug. 2000.- [38] M. Haindl and P. Vácha, “Illumination Invariant Texture Retrieval,”
Proc. 18th Int'l Conf. Pattern Recognition, pp. 276-279, Aug. 2006.- [40] E. Hayman, B. Caputo, M. Fritz, and J. Eklundh, “On the Significance of Real-World Conditions for Material Classification,”
Proc. Eighth European Conf. Computer Vision, pp. 253-266, 2004.- [41] D. Heeger and J. Bergen, “Pyramid Based Texture Analysis/Synthesis,”
Proc. ACM SIGGRAPH, pp. 229-238, 1995.- [46] R. Kashyap, “Analysis and Synthesis of Image Patterns by Spatial Interaction Models,”
Progress in Pattern Recognition, vol. 1, pp. 149-186, Elsevier, 1981.- [48] J. Kautz, M. Sattler, R. Sarlette, R. Klein, and H.-P. Seidel, “Decoupling BRDFs from Surface Mesostructures,”
Proc. Graphics Interface Conf. '04, pp. 177-184, 2004.- [49] H. Kawasaki, K.-D. Seo, Y. Ohsawa, and R. Furukawa, “Patch-Based BTF Synthesis for Real-Time Rendering,”
Proc. IEEE Int'l Conf. Image Processing, vol. 1, pp. 393-396, Sept. 2005.- [50] M. Koudelka, S. Magda, P. Belhumeur, and D. Kriegman, “Acquisition, Compression, and Synthesis of Bidirectional Texture Functions,”
Proc. Third Int'l Workshop Texture Analysis and Synthesis, pp. 47-52, Oct. 2003.- [51] V. Kwatra, A. Schodl, I. Essa, G. Turk, and A. Bobick, “Graphcut Textures: Image and Video Synthesis Using Graph Cuts,”
ACM Trans. Graphics, vol. 22, no. 3 pp. 277-286, July 2003.- [52] E.P. Lafortune, S.C. Foo, K.E. Torrance, and D.P. Greenberg, “Non-Linear Approximation of Reflectance Functions,”
Computer Graphics, vol. 31, pp. 117-126, 1997.- [57] T. Leung and J. Malik, “Representing and Recognizing the Visual Appearance of Materials Using Three-Dimensional Textons,”
Int'l J. Computer Vision, vol. 43, no. 1, pp. 29-44, 2001.- [60] W.-C. Ma, S.-H. Chao, B.-Y. Chen, C.-F. Chang, M. Ouhyoung, and T. Nishita, “An Efficient Representation of Complex Materials for Real-Time Rendering,”
Proc. ACM Symp. Virtual Reality Software and Technology, pp. 150-153, 2004.- [62] S. Magda and D. Kriegman, “Reconstruction of Volumetric Surface Textures for Real-Time Rendering,”
Proc. 17th Eurographics Workshop Rendering, pp. 19-29, June 2006.- [63] T. Malzbender, D. Gelb, and H. Wolters, “Polynomial Texture Maps,”
Proc. ACM SIGGRAPH, pp. 519-528, 2001.- [65] D.K. McAllister, A. Lastra, and W. Heidrich, “Efficient Rendering of Spatial Bi-Directional Reflectance Distribution Functions,”
Graphics Hardware, pp. 77-88, 2002.- [66] M. McCool, J. Ang, and A. Ahmad, “Homomorphic Factorization of BRDFs for High-Performance Rendering,”
Proc. ACM SIGGRAPH, pp. 185-194, 2001.- [67] J. Meseth, G. Müller, and R. Klein, “Preserving Realism in Real-Time Rendering of Bidirectional Texture Functions,”
Proc. OpenSG Symp., pp. 89-96, Apr. 2003.- [68] J. Meseth, G. Müller, R. Klein, F. Röder, and M. Arnold, “Verification of Rendering Quality from Measured BTFs,”
Proc. Third Symp. Applied Perception in Graphics and Visualization, vol. 153, pp. 127-134, July 2006.- [69] J. Meseth, G. Müller, M. Sattler, and R. Klein, “BTF Rendering for Virtual Environments,”
Proc. Conf. Virtual Concepts 2003, pp. 356-363, Nov. 2003.- [70] G. Müller, G. Bendels, and R. Klein, “Rapid Synchronous Acquisition of Geometry and BTF for Cultural Heritage Artefacts,”
Proc. Sixth Int'l Symp. Virtual Reality, Archaeology and Cultural Heritage, pp. 13-20, 2005.- [71] G. Müller, J. Meseth, and R. Klein, “Compression and Real-Time Rendering of Measured BTFs Using Local PCA,”
Proc. Conf. Vision, Modeling, and Visualisation, pp. 271-280, Nov. 2003.- [72] G. Müller, J. Meseth, M. Sattler, R. Sarlette, and R. Klein, “Acquisition, Synthesis and Rendering of Bidirectional Texture Functions,”
Proc. Eurographics 2004 State of the Art Reports, pp. 69-94, Sept. 2004.- [73] A. Neubeck, A. Zalesny, and L. Gool, “3D Texture Reconstruction from Extensive BTF Data,”
Proc. Fourth Int'l Workshop Texture Analysis and Synthesis, pp. 13-18, Oct. 2005.- [74] A. Neubeck, A. Zalesny, and L. Van Gool, “Viewpoint Consistent Texture Synthesis,”
Proc. Conf. 3D Data Processing, Visualization and Transmission, pp. 388-395, Sept. 2004.- [75] A. Ngan and F. Durand, “Statistical Acquisition of Texture Appearance,”
Proc. Eurographics Symp. Rendering '05, pp. 31-40, Aug. 2006.- [76] F. Nicodemus, R.J.C.J. Hsia, I. Ginsburg, and T. Limperis, “Geometrical Considerations and Nomenclature for Reflectance,” NBS Monograph 160, Nat'l Bureau of Standards, US Dept. of Commerce, pp. 1-52, 1977.
- [77] F. Pellacini and J. Lawrence, “AppWand: Editing Measured Materials Using Appearance-Driven Optimization,”
ACM Trans. Graphics, vol. 26, no. 3, pp. 54:1-54:10, 2007.- [78] S.C. Pont and J.J. Koenderink, “Bidirectional Texture Contrast Function,”
Int'l J. Computer Vision, vol. 62, nos. 1/2, pp. 17-34, 2005.- [80] M. Sattler, R. Sarlette, and R. Klein, “Efficient and Realistic Visualization of Cloth,”
Proc. Eurographics Symp. Rendering, pp.167-178, June 2003.- [81] P. Somol and M. Haindl, “Novel Path Search Algorithm for Image Stitching and Advanced Texture Tiling,”
Proc. 13th Int'l Conf. in Central Europe on Computer Graphics, Visualization and Computer Vision, pp. 155-162, 2005.- [84] X. Tong, J. Zhang, L. Liu, B. Wang, X. Guo, and H.-Y. Shum, “Synthesis of Bidirectional Texture Functions on Arbitrary Surfaces,”
Proc. ACM SIGGRAPH, pp. 665-672, 2002.- [85] P. Vacha and M. Haindl, “Image Retrieval Measures Based on Illumination Invariant Textural MRF Features,”
Proc. Sixth ACM Int'l Conf. Image and Video Retrieval, pp. 448-454, 2007.- [86] M. Vasilescu and D. Terzopoulos, “Tensor Textures: Multilinear Image-Based Rendering,”
Proc. ACM SIGGRAPH, vol. 23, no. 3 pp.336-342, Aug. 2004.- [88] J. Wang and K. Dana, “Hybrid Textons: Modeling Surfaces with Reflectance and Geometry,”
Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 372-378, 2004.- [89] J. Wang and K. Dana, “Relief Texture from Specularities,”
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 3, pp.446-457, Mar. 2006.- [92] F. Wichmann and N. Hill, “The Psychometric Function: I. Fitting, Sampling, and Goodness of Fit,”
Perception & Psychophysics, vol. 63, no. 8, pp. 1293-1313, 2001.- [94] Y. Xu, B. Guo, and H. Shum, “Chaos Mosaic: Fast and Memory Efficient Texture Synthesis,” Technical Report MSR-TR-2000-32, Microsoft Research, 2000.
- [95] H. Yacov, T. Malzbender, and D. Gelb, “Synthesis of Reflectance Function Textures from Examples,”
Proc. Third Int'l Workshop Texture Analysis and Synthesis, pp. 47-52, Oct. 2003.- [96] J. Yellott, “Implications of Triple Correlation Uniqueness for Texture Statistics and the Julesz Conjecture,”
J. Optical Soc. Am., vol. 10, no. 5 pp. 777-793, May 1993.- [97] S. Zelinka and M. Garland, “Interactive Texture Synthesis on Surfaces Using Jump Maps,”
Proc. 14th Eurographics Workshop Rendering, pp. 90-96, 2003. |