This Article 
 Bibliographic References 
 Add to: 
Conveying the 3D Shape of Smoothly Curving Transparent Surfaces via Texture
April-June 1997 (vol. 3 no. 2)
pp. 98-117

Abstract—Transparency can be a useful device for depicting multiple overlapping surfaces in a single image. The challenge is to render the transparent surfaces in such a way that their three-dimensional shape can be readily understood and their depth distance from underlying structures clearly perceived.

This paper describes our investigations into the use of sparsely-distributed discrete, opaque texture as an "artistic device" for more explicitly indicating the relative depth of a transparent surface and for communicating the essential features of its 3D shape in an intuitively meaningful and minimally occluding way. The driving application for this work is the visualization of layered surfaces in radiation therapy treatment planning data, and the technique is illustrated on transparent isointensity surfaces of radiation dose.

We describe the perceptual motivation and artistic inspiration for defining a stroke texture that is locally oriented in the direction of greatest normal curvature (and in which individual strokes are of a length proportional to the magnitude of the curvature in the direction they indicate), and discuss two alternative methods for applying this texture to isointensity surfaces defined in a volume.

We propose an experimental paradigm for objectively measuring observers' ability to judge the shape and depth of a layered transparent surface, in the course of a task relevant to the needs of radiotherapy treatment planning, and use this paradigm to evaluate the practical effectiveness of our approach through a controlled observer experiment based on images generated from actual clinical data.

[1] B. Bauer-Kirpes, W. Schlegel, R. Boesecke, and W.J. Lorenz, "Display of Organs and Isodoses as Shaded 3-D Objects for 3-D Therapy Planning," Int'l J. Radiation Oncology, Biology, Physics, vol. 13, pp. 135-140, 1987.
[2] A. Blake, H.H. Bülthoff, and D. Sheinberg, "Shape from Texture: Ideal Observers and Human Psychophysics," Vision Research, vol. 33, no. 12, pp. 1,723-1,737, 1993.
[3] J. Beck and R. Ivry, "On the Role of Figural Organization in Perceptual Transparency," Perception and Psychophysics, vol. 44, no. 6, pp. 585-594, 1988.
[4] A. Blake and H. Bülthoff, "Shape from Specularities: Computation and Psychophysics," Philosophical Trans. Royal Soc. London, B, vol. 331, pp. 237-252, 1991.
[5] M. Brady, J. Ponce, A. Yuille, and H. Asada, "Describing Surfaces," Proc. Second Int'l Symp. Robotics Research, H. Hanafusa and H. Inoue, eds., pp. 5-16, 1985.
[6] N. Bruno and J.E. Cutting, "Minimodularity and the Perception of Layout," J. Experimental Psychology: General, vol. 117, no. 2, pp. 161-170, 1988.
[7] P. Cavanagh and Y.G. Leclerc, "Shape from Shadows," J. Experimental Psychology: Human Perception and Performance, vol. 15, no. 1, pp. 3-27, 1989.
[8] M.L. Connolly, "Solvent-Accessible Surfaces of Proteins and Nucleic Acids," Science, vol. 221, no. 4,612, pp. 709-713, 1983.
[9] B.G. Cumming, E.B. Johnston, and A.J. Parker, "Effects of Different Texture Cues on Curved Surfaces Viewed Stereoscopically," Vision Research, vol. 33, nos. 5/6, pp. 827-838, 1993.
[10] J.E. Cutting and R.T. Millard, "Three Gradients and the Perception of Flat and Curved Surfaces," J. Experimental Psychology: General, vol. 113, no. 2, pp. 198-216, 1984.
[11] D. Dooley and M.F. Cohen, "Automatic Illustration of 3D Geometric Models: Surfaces," Proc. Visualization '90, pp. 307-313.
[12] Howard R. Flock and Anthony Moscatelli, "Variables of Surface Texture and Accuracy of Space Perceptions," Perceptual and Motor Skills, vol. 19, pp. 327-334, 1964.
[13] W. Frobin and E. Hierholzer, "Analysis of Human Back Shape Using Surface Curvatures," J. Biomechanics, vol. 15, no. 5, pp. 379-390, 1982.
[14] M. Fukuda and S. Masin, "Test of Balanced Transparency," Perception, vol. 23, no. 1, pp. 37-43, 1994.
[15] J.J. Gibson, "The Perception of Visual Surfaces," American J. Psychology, vol. 63, pp. 367-384, 1950.
[16] A. Glassner, An Introduction to Ray Tracing, Academic Press, San Diego, Calif., 1991.
[17] N. Guid, C. Oblonsek, and B. Zalik, "Surface Interrogation Methods," Computers&Graphics, vol. 19, no. 4, pp. 557-574, 1995.
[18] A. Guptill, Rendering in Pen and Ink. Watson-Guptill Publications, 1976.
[19] H. Hagen et al., "Surface Interrogation Algorithms," IEEE Computer Graphics and Applications, Vol. 12, No. 5, Sept. 1992, pp. 53-60.
[20] D. Hilbert and S. Cohn-Vossen, Geometry and the Imagination, P. Nemenyi (translation). Chelsea Publishing Co., 1952.
[21] E.R.S. Hodges, The Guild Handbook of Scientific Illustration. Van Nostrand Reinhold, 1989.
[22] V. Interrante, "Illustrating Transparency: Communicating the 3D Shape of Layered Transparent Surfaces via Texture," PhD thesis, Univ. of North Carolina at Chapel Hill, 1996.
[23] V. Interrante, H. Fuchs, and S. Pizer, “Enhancing Transparent Skin Surfaces with Ridge and Valley Lines,” Proc. IEEE Visualization '95, G. Nielson and D. Silver, eds, pp. 52-59, Oct. 1995.
[24] J.J. Koenderink and A.J. van Doorn, "Photometric Invariants Related to Solid Shape," Optica Acta, vol. 27, no. 7, pp. 981-996, 1980.
[25] J. Koënderink, Solid Shape. Cambridge, Mass.: MIT Press, 1991.
[26] J. Koenderink and A.J. van Doorn, "Relief: Pictorial and Otherwise," Image and Vision Computing, vol. 13, no. 5, pp. 321-334, June 1995.
[27] H.L. Kundel, "Perception and Representation of Medical Images," SPIE Image Processing, vol. 1,898, pp. 2-12, 1993.
[28] G.T. Herman and H. Levkowitz, “Color Scales for Image Data,” Computer Graphics and Applications, pp. 72-80, 1992.
[29] M. Levoy et al., "Volume Rendering in Radiation Treatment Planning," Proc. 1st Conf. Visualization in Biomedical Computing, IEEE CS Press, 1990, pp. 4-10.
[30] M. Levoy, “Display of Surfaces from Volume Data,” IEEE Computer Graphics and Applications, vol. 8, no. 3, pp. 29-37, 1988.
[31] M.S. Livingstone and D.H. Hubel, "Psychophysical Evidence for Separate Channels for the Perception of Form, Color, Movement and Depth," J. Neuroscience, vol. 7, no. 11, pp. 3,416-3,468, 1987.
[32] W.E. Loechel, Medical Illustration: A Guide for the Doctor-Author and Exhibitor. Charles C. Thomas, 1964.
[33] W.E. Lorensen and H.E. Cline, “Marching Cubes: A High Resolution 3D Surface Construction Algorithm,” Computer Graphics (SIGGRAPH '87 Proc.), vol. 21, pp. 163-169, 1987.
[34] T. Maekawa and N.M. Patrikalakis, "Interrogation of Differential Geometry Properties for Design and Manufacture," The Visual Computer, vol. 10, no. 4, pp. 216-237, 1994.
[35] F. Metelli, "The Perception of Transparency," Scientific American, vol. 230, pp. 47-54, 1974.
[36] O. Monga, S. Benayoun, and O. Faugeras, “From Partial Derivatives of 3D Density Images to Ridge Lines,” Proc. IEEE Conf. on Vision and Pattern Recognition, IEEE CS Press, Los Alamitos, Calif., 1992, pp. 354–359.
[37] H.P. Moreton, "Simplified Curve and Surface Interrogation via Mathematical Packages and Graphics Libraries and Hardware," Computer-Aided Design, vol. 27, no. 7, pp. 523-543, 1995.
[38] K. Nakayama, S. Shimojo, and, V.S. Ramachandran, "Transparency: Relation to Depth, Subjective Contours, Luminance and Neon Color Spreading," Perception, vol. 19, pp. 497-513, 1990.
[39] J. Nielsen and J. Levy, "Measuring Usability: Preference vs. Performance," Comm. ACM, vol. 37, no. 4, pp. 66-75, Apr. 1994.
[40] D.R. Peachey, “Solid Texturing of Complex Surfaces,” Proc. SIGGRAPH 85, vol. 19, pp. 279-286, 1985.
[41] Photon Treatment Planning Collaborative Working Group, "Three-Dimensional Display in Planning Radiation Therapy: A Clinical Perspective," Int'l J. Radiation Oncology, Biology, Physics, vol. 21, pp. 79-89, 1991,
[42] H.C. Pitz, Ink Drawing Techniques. Watson-Guptill Publications, 1957.
[43] P. Rheingans, "Opacity-Modulating Triangular Textures for Irregular Surfaces," Visualization 96, IEEE Computer Society Press, Los Alamitos, Calif., 1996, pp. 219-225.
[44] W. Richards, J. Koenderink, and D. Hoffman, "Inferring Three-Dimensional Shapes from Two-Dimensional Silhouettes," J. Optical Soc. Am., A, Optics and Imaging Science, vol. 4, pp. 1,168-1,175, July 1987.
[45] T. Saito, "Real-Time Previewing for Volume Visualization," Proc. 1994 Symp. Volume Visualization, pp. 99-104, 1994.
[46] T. Saito and T. Takahashi, “Comprehensible Rendering of 3D Shapes,” Computer Graphics (Proc. Siggraph), Vol. 24, No. 4, Aug. 1990, pp. 197-206.
[47] M.P. Salisbury et al., "Interactive Pen-And-Ink Illustration," Proc. Siggraph 94, ACM Press, 1994, pp. 101-108.
[48] M.P. Salisbury, C. Anderson, D. Lischinski, and D.H. Salesin, "Scale-Dependent Reproduction of Pen-and-Ink Illustrations," Computer Graphics (Proc. Siggraph '96), pp. 461-468, 1996.
[49] P.T. Sander and S.W. Zucker, "Tracing Surfaces for Surfacing Traces," Proc. First Int'l Conf. Computer Vision, pp. 241-249, 1987.
[50] D. Schweitzer, “Artificial Texturing: An Aid to Surface Visualization,” Computer Graphics (SIGGRAPH '83 Conf. Proc.), vol. 17, no. 3, pp. 23-29, 1983.
[51] K.A. Stevens, "The Visual Interpretation of Surface Contours," Artificial Intelligence, vol. 17, pp. 47-73, 1981.
[52] K.A. Stevens and A. Brookes, "Probing Depth in Monocular Images," Biological Cybernetics, vol. 56, pp. 355-366, 1987.
[53] E.J. Sullivan, Line: An Art Study. Chapman&Hall, 1922.
[54] J.T. Todd and E. Mingolla, "Perception of Surface Curvature and Direction of Illumination from Patterns of Shading," J. Experimental Psychology: Human Perception and Performance, vol. 9, no. 4, pp. 583-595, 1983.
[55] J.T. Todd and R.A. Akerstrom, "Perception of Three-Dimensional Form from Patterns of Optical Texture," J. Experimental Psychology: Human Perception and Performance, vol. 13, no. 2, pp. 242-255, 1987.
[56] J.T. Todd and F.D. Reichel, "Ordinal Structure in the Visual Perception and Cognition of Smoothly Curved Surfaces," Psychological Review, vol. 96, no. 4, pp. 643-657, 1989.
[57] J.T. Todd and F.D. Reichel, "Visual Perception of Smoothly Curved Surfaces from Double-Projected Contour Patterns," J. Experimental Psychology: Human Perception and Performance, vol. 16, no. 3, pp. 665-674, 1990.
[58] G. Winkenbach and D.H. Salesin, “Computer-Generated Pen-and-Ink Illustration,” Computer Graphics (Proc. Siggraph), Vol. 28, No. 4, Oct. 1994, pp. 91-108.
[59] G. Winkenbach and D.H. Salesin, "Rendering Parametric Surfaces in Pen and Ink," Proc. Siggraph 96, ACM Press, 1996, pp. 469-476.
[60] M.J. Young, M.S. Landy, and L.T. Maloney, "A Perturbation Analysis of Depth Perception from Combinations of Texture and Motion Cues," Vision Research, vol. 33, no. 18, pp. 2,685-2,696, 1993.
[61] A. Zisserman, P. Giblin, and A. Blake, “The Information Available to a Moving Observer from Specularities,” Image and Visual Computing, vol. 7, pp. 287-291, 1989.

Index Terms:
Transparent surfaces, shape and depth perception, shape representation, principal direction texture.
Victoria Interrante, Henry Fuchs, Stephen M. Pizer, "Conveying the 3D Shape of Smoothly Curving Transparent Surfaces via Texture," IEEE Transactions on Visualization and Computer Graphics, vol. 3, no. 2, pp. 98-117, April-June 1997, doi:10.1109/2945.597794
Usage of this product signifies your acceptance of the Terms of Use.