This Article 
 Bibliographic References 
 Add to: 
Conveying Shape with Texture: Experimental Investigations of Texture's Effects on Shape Categorization Judgments
July/August 2004 (vol. 10 no. 4)
pp. 471-483

Abstract—In this paper, we describe the results of two comprehensive controlled observer experiments intended to yield insight into the following question: If we could design the ideal texture pattern to apply to an arbitrary smoothly curving surface in order to enable its 3D shape to be most accurately and effectively perceived, what would the characteristics of that texture pattern be? We begin by reviewing the results of our initial study in this series, which were presented at the 2003 IEEE Symposium on Information Visualization, and offer an expanded analysis of those findings. We continue by presenting the results of a follow-on study in which we sought to more specifically investigate the separate and combined influences on shape perception of particular texture components, with the goal of obtaining a clearer view of their potential information carrying capacities. In each study, we investigated the observers' ability to identify the intrinsic shape category of a surface patch (elliptical, hyperbolic, cylindrical, or flat) and its extrinsic surface orientation (convex, concave, both, or neither). In our first study, we compared performance under eight different texture type conditions, plus two projection conditions (perspective or orthographic) and two viewing conditions (head-on or oblique). In this study, we found that: 1) Shape perception was better facilitated, in general, by the bidirectional "principal direction grid” pattern than by any of the seven other patterns tested; 2) shape type classification accuracy remained high under the orthographic projection condition for some texture types when the viewpoint was oblique; 3) perspective projection was required for accurate surface orientation classification; and 4) shape classification accuracy was higher when the surface patches were oriented at a (generic) oblique angle to the line of sight than when they were oriented (in a nongeneric pose) to face the viewpoint straight on. In our second study, we compared performance under eight new texture type conditions, redesigned to facilitate gathering insight into the cumulative effects of specific individual directional components in a wider variety of multidirectional texture patterns. In this follow-on study, we found that shape classification accuracy was equivalently good under a variety of test patterns that included components following either the first or first and second principal directions, in addition to other directions, suggesting that a principal direction grid texture is not the only possible "best option” for enhancing shape representation.

[1] V. Interrante and S. Kim, Investigating the Effect of Texture Orientation on Shape Perception Proc. Human Vision and Electronic Imaging VI, pp. 330-339, 2001.
[2] V. Interrante, S. Kim, and H. Hagh-Shenas, Conveying 3D Shape with Texture: Recent Advances and Experimental Findings Proc. Human Vision and Electronic Imaging VII, pp. 197-206, 2002.
[3] S. Kim, H. Hagh-Shenas, and V. Interrante, Showing Shape with Texture: Two Directions Seem Better than One Proc. Human Vision and Electronic Imaging VIII, pp. 332-339, 2003.
[4] R.G.F. Erens, A. Kappers, and J. Koenderink, Perception of Local Shape from Shading Perception&Psychophysics, vol. 54, no. 2, pp. 145-156, 1993.
[5] P. Mamassian and D. Kersten, Illumination, Shading and Perception of Local Orientation Vision Research, vol. 36, no. 15, pp. 2351-2367, 1996.
[6] J. Todd, F. Norman, J. Koenderink, and A. Kappers, Effects of Texture, Illumination, and Surface Reflectance on Stereoscopic Shape Perception Perception, vol. 26, pp. 807-822, 1997.
[7] B.G. Cumming, E.B. Johnston, and A.J. Parker, Effects of Different Texture Cues on Curved Surfaces Viewed Stereoscopically Vision Research, vol. 33, nos. 5/6, pp. 827-838, 1993.
[8] G. Gorla, V. Interrante, and G. Sapiro, Texture Synthesis for 3D Shape Representation IEEE Trans. Visualization and Computer Graphics, vol. 9, no. 4, pp. 512-524, Oct.-Dec. 2003.
[9] D. Knill, Contour into Texture: Information Content of Surface Contours and Texture Flow J. Optical Soc. Am., vol. A, no. 1, pp. 12-35, Jan. 2001.
[10] A. Li and Q. Zaidi, Perception of Three-Dimensional Shape from Texture Is Based on Patterns of Oriented Energy Vision Research, vol. 40, no. 2, pp. 217-242, 2000.
[11] J.T. Todd and F.D. Reichel, Visual Perception of Smoothly Curved Surfaces from Double-Projected Contour Patterns J. Experimental Psychology: Human Perception and Performance, vol. 16, no. 3, pp. 665-674, 1990.
[12] R. Rosenholtz and J. Malik, Surface Orientation from Texture: Isotropy or Homogeneity (or Both)? Vision Research, vol. 37, no. 16, pp. 2283-2293, 1997.
[13] A. Li and Q. Zaidi, Information Limitations in the Perception of Shape from Texture Vision Research, vol. 41, no. 22, pp. 2927-2942, 2001.
[14] K. Stevens, The Information Content of Texture Gradients Biological Cybernetics, vol. 42, pp. 95-105, 1981.
[15] P. Mamassian and M. Landy, Observer Biases in the 3D Interpretation of Line Drawings Vision Research, vol. 38, no. 18, pp. 2817-2832, 1998.
[16] J.T. Todd and A.H.J. Oomes, Generic and Non-Generic Conditions for the Perception of the Surface Shape from Texture Vision Research, vol. 42, no. 7, pp. 837-850, 2002.
[17] J.J. Koenderink, A. Doorn, and A. Kappers, Surface Perception in Pictures Perception, vol. 52, pp. 487-496, 1992.
[18] P. Brodatz, Textures: A Photographic Album for Artists and Designers. Dover Publications, 1966.
[19] J.J. Koenderink, Solid Shape. MIT Press, 1990.

Index Terms:
Three-dimensional graphics and realism, vision and scene understanding, shape perception, shape representation, texture, principal directions.
Sunghee Kim, Haleh Hagh-Shenas, Victoria Interrante, "Conveying Shape with Texture: Experimental Investigations of Texture's Effects on Shape Categorization Judgments," IEEE Transactions on Visualization and Computer Graphics, vol. 10, no. 4, pp. 471-483, July-Aug. 2004, doi:10.1109/TVCG.2004.5
Usage of this product signifies your acceptance of the Terms of Use.