This Article 
 Bibliographic References 
 Add to: 
Volume Illustration of Muscle from Diffusion Tensor Images
November/December 2009 (vol. 15 no. 6)
pp. 1425-1432
Wei Chen, State Key Lab of CAD&CG, Zhejiang University
Zhicheng Yan, State Key Lab of CAD&CG, Zhejiang University
Song Zhang, Department of Computer Science and Engineering, Mississippi State University
John Allen Crow, College of Veterinary Medicine, Mississippi State University
David S. Ebert, Purdue University
Ronald M. McLaughlin, College of Veterinary Medicine, Mississippi State University
Katie B. Mullins, College of Veterinary Medicine, Mississippi State University
Robert Cooper, College of Veterinary Medicine, Mississippi State University
Zi'ang Ding, State Key Lab of CAD&CG,Zhejiang University
Jun Liao, Department of Agriculture and Biomedical Engineering, Mississippi State University
Medical illustration has demonstrated its effectiveness to depict salient anatomical features while hiding the irrelevant details. Current solutions are ineffective for visualizing fibrous structures such as muscle, because typical datasets (CT or MRI) do not contain directional details. In this paper, we introduce a new muscle illustration approach that leverages diffusion tensor imaging (DTI) data and example-based texture synthesis techniques. Beginning with a volumetric diffusion tensor image, we reformulate it into a scalar field and an auxiliary guidance vector field to represent the structure and orientation of a muscle bundle. A muscle maskderived from the input diffusion tensor image is used to classify the muscle structure. The guidance vector field is further refined to remove noise and clarify structure. To simulate the internal appearance of the muscle, we propose a new two-dimensional example based solid texture synthesis algorithm that builds a solid texture constrained by the guidance vector field. Illustrating the constructed scalar field and solid texture efficiently highlights the global appearance of the muscle as well as the local shape and structure of the muscle fibers in an illustrative fashion. We have applied the proposed approach to five example datasets (four pig hearts and a pigleg), demonstrating plausible illustration and expressiveness.

[1] S. Aja-Fernandez, M. Niethammer, M. Kubicki, M. Shenton, and C. F. Westin, Restoration of DWI data using a Rician LMMSE estimator. IEEE Transactions on Medical Imaging, 27 (10): 1389–403, 2008.
[2] D. C. Banks, Illumination in diverse codimensions. In Proceedings of ACM SIGGRAPH, pages 327–334, 1994.
[3] P. J. Basser, S. Pajevic, C. Pierpaoli, J. Duda, and A. Aldroubi, In vivo fiber tractography using DT-MRI data. Magnetic Resonance in Medicine, 44: 625–632, 2000.
[4] S. Basu, P. Fletcher, and R. Whitaker, Rician noise removal in diffusion tensor MRI. Lecture Notes in Computer Science, 4190: 117, 2006.
[5] S. Blemker and S. Delp, Three-dimensional representation of complex muscle architectures and geometries. Annals of Biomedical Engineering, 33: 661–C673, 2005.
[6] S. Bruckner and M. E. Gröller, VolumeShop: An interactive system for direct volume illustration. In Proceedings of IEEE Visualization, pages 671–678, Minneapolis, USA, October 2005.
[7] B. Cabral and L. Leedom, Imaging vector fields using line integral convolution. In Proceedings of ACM SIGGRAPH, pages 263–270, 1993.
[8] W. Chen, S. Zhang, S. Correia, and D. S. Ebert, Abstractive representation and exploration of hierarchically clustered diffusion tensor fiber tracts. Computer Graphics Forum (Special Issue of Eurographics/IEEEVGTC Symposium on Visualization), 27 (3), 2008.
[9] Y. Chen and H. IP, Texture evolution: 3D texture synthesis from single 2D growable texture pattern. The Visual Computer, 20 (10): 650–664, 2004.
[10] C. Correa, D. Silver, and M. Chen, Feature-aligned volume manipulation for illustration and visualization. IEEE Transactions on Visualization and Computer Graphics, 12 (5): 1069–1076, 2006.
[11] O. Coulon, D. Alexander, and S. Arridge, Diffusion tensor magnetic resonance image regularization. Medical Image Analysis, 8 (1): 47–67, 2004.
[12] J. Dauguet, S. Peled, V. Berezovskii, T. Delzescaux, S. K. Warfield, R. Born, and C.-F. Westin, Comparison of fiber tracts derived from invivo DTI tractography with 3D histological neural tract tracer reconstruction on a macaque brain. NeuroImage, 37: 530–538, 2007.
[13] F. Dong, G. Clapworthy, M. Krokos, and J. Yao, An anatomy-based approach to human muscle modeling and deformation. IEEE Transactions on Visualization and Computer Graphics, 08 (2): 154–170, 2002.
[14] F. Dong and G. J. Clapworthy, Volumetric texture synthesis for nonphotorealistic volume rendering of medical data. The Visual Computer, 21 (7): 463–473, 2005.
[15] D. Ebert and P. Rheingans, Volume illustration: Non-photorealistic rendering of volume models. In Proceedings of IEEE Visualization, pages 253–264, Boston, USA, October 2002.
[16] A. Efros and W. T. Freeman, Image quilting for texture synthesis and transfer. In Proceedings of ACM SIGGRAPH, pages 341–346, 2001.
[17] F. Enders, N. Sauber, D. Merhof, P. Hastreiter, C. Nimsky, and M. Stamminger, Visualization of white matter tracts with wrapped streamlines. In Proceedings of IEEE Visualization 2005, pages 51–58, 2005.
[18] D. B. Ennis, G. Kindlman, I. Rodriguez, P. A. Helm, and E. R. McVeigh, DTI visualization of tensor fields using superquadric glyphs. Magnetic Resonance in Medicine, 53 (1): 169–176, 2005.
[19] D. J. Heeger and J. R. Bergen, Pyramid-based texture analysis and synthesis. In Proceedings of ACM SIGGRAPH, pages 229–238, 1995.
[20] E. Hsu, Generalized line integral convolution rendering of diffusion tensor fields. In Proceedings of International Society of Magnetic Resonance Medical, page 790, 2001.
[21] R. Jagnow, J. Dorsey, and H. Rushmeier, Stereological techniques for solid textures. ACM Transactions on Graphics, 23 (3): 329–335, 2004.
[22] G. Kindlmann, D. Weinstein, and D. Hart, Strategies for direct volume rendering of diffusion tensor fields. IEEE Transactions on Visualization and Computer Graphics, 6 (2): 124–138, April-June 2000.
[23] G. Kindlmann and C.-F. Westin, Diffusion tensor visualization with glyph packing. IEEE Transactions on Visualization and Computer Graphics, 12 (5): 1329–1336, 2006.
[24] J. Kopf, C.-W. Fu, D. Cohen-Or, O. Deussen, D. Lischinski, and T.-T. Wong, Solid texture synthesis from 2D exemplars. ACM Transactions on Graphics, 26 (3), 2007.
[25] A. Lu and D. Ebert, Example-based volume illustrations. In Proceedings of IEEE Visualization, pages 655–662, Minneapolis, USA, October 2005.
[26] S. Owada, F. Nielsen, M. Okabe, and T. Igarashi, Volume illustration: Designing 3D models with internal textures. In Proceedings of ACM SIGGRAPH, pages 322–328, San Diego, USA, August 2004.
[27] T. Peeters, A. Vilanova, G. Strijkers, and B. H. Romeny, Visualization of the fibrous structure of the heart. In Proceedings of Vision Modeling and Visualization, pages 309–317, 2006.
[28] J.-M. Peyrat, M. Sermesant, X. Pennec, H. Delingette, C. Xu, E. McVeigh, and N. Ayache, Towards a statistical atlas of cardiac fiber structure. In MICCAI, pages 297–304, 2006.
[29] D. Rohmer, A. Sitek, and G. T. Gullberg, Reconstruction and visualization of fiber and laminar structure in the normal human heart from ex vivo diffusion tensor magnetic resonance imaging (DTMRI) data. Investigative Radiology, 42 (11): 777–789, 2007.
[30] F. Scheepers, R. E. Parent, W. E. Carlson, and S. F. May, Anatomy-based modeling of the human musculature. In Proceedings of ACM SIGGRAPH, pages 163–172, 1997.
[31] D. Scollan, A. Holmes, R. Winslow, and J. Forder, Histological validation of myocardial microstructure obtained from diffusion tensor magnetic resonance imaging. American Journal of Physiology, 275: 2308–2318, 1998.
[32] S. Sinha, U. Sinha, and V. R. Edgerton, In vivo diffusion tensor imaging of the human calf muscle. Journal of Magnetic Resonance Imaging, 24 (1), 2006.
[33] S. M. Smith, Fast robust automated brain extraction. Human Brain Mapping, 17 (3): 143–155, 2002.
[34] J. Staubesand and A. N. Taylor, Sobotta Atlas of human anatomy. Urban and Schwarzenberg Baltimore-Munich, 1990.
[35] N. Svakhine, D. Ebert, and D. Stredney, Illustration motifs for effective medical volume illustration. IEEE Computer Graphics and Applications, 25 (3), 2005.
[36] K. Takayama, M. Okabe, T. Ijiri, and T. Igarashi, Lapped solid textures: Filling a model with anisotropic textures. ACM Transactions on Graphics, 27 (3), 2008.
[37] J. Teran, E. Sifakis, S. Blemker, V. Ng-Thow-Hing, C. Lau, and R. Fedkiw, Creating and simulating skeletal muscle from the visible human data set. IEEE Transactions on Visualization and Computer Graphics, 11 (3): 317–328, 2005.
[38] D. Tschumperle and R. Deriche, Variational frameworks for DT-MRI estimation, regularization and visualization. In Proceedings of IEEE International Conference on Computer Vision, pages 116–121, 2003.
[39] A. Vilanova, G. Berenschot, and C. van Pul, DTI visualization with stream surfaces and evenly-spaced volume seeding. In Eurographics/IEEE Symposium on Visualization, pages 173–182, 2004.
[40] A. Vilanova, S. Zhang, G. Kindlmann, and D. H. Laidlaw, An introduction to visualization of diffusion tensor imaging and its applications. In Visualization and Image Processing of Tensor Fields. Springer, 2005.
[41] L.-Y. Wei, Texture synthesis by fixed neighborhood searching. PhD thesis, Stanford University, 2002.
[42] A. Wenger, D. Keefe, S. Zhang, and D. H. Laidlaw, Interactive volume rendering of thin thread structures within multivalued scientific datasets. IEEE Transactions on Visualization and Computer Graphics, 10 (6): 664–672, November 2004.
[43] C. Westin, S. Peled, H. Gubjartsson, R. Kikinis, and F. Jolesz, Geometrical diffusion measures for MRI from tensor basis analysis. In Proceedings of International Society Magnetic Resonance in Medicine (ISMRM), 1997.
[44] S. Zhang, C. Demiralp, and D. H. Laidlaw, Visualizing diffusion tensor MR images using streamtubes and streamsurfaces. IEEE Transactions on Visualization and Computer Graphics, 9 (4): 454–462, October 2003.
[45] L. Zhukov and A. H. Barr, Heart-muscle fiber reconstruction from Diffusion Tensor MRI. In Proceedings of IEEE Visualization, pages 79–84, 2003.

Index Terms:
Illustrative Visualization, Diffusion Tensor Image, Muscle, Solid Texture Synthesis
Wei Chen, Zhicheng Yan, Song Zhang, John Allen Crow, David S. Ebert, Ronald M. McLaughlin, Katie B. Mullins, Robert Cooper, Zi'ang Ding, Jun Liao, "Volume Illustration of Muscle from Diffusion Tensor Images," IEEE Transactions on Visualization and Computer Graphics, vol. 15, no. 6, pp. 1425-1432, Nov.-Dec. 2009, doi:10.1109/TVCG.2009.203
Usage of this product signifies your acceptance of the Terms of Use.