This Article 
 Bibliographic References 
 Add to: 
Tissue Classification Based on 3D Local Intensity Structures for Volume Rendering
April-June 2000 (vol. 6 no. 2)
pp. 160-180

Abstract—This paper describes a novel approach to tissue classification using three-dimensional (3D) derivative features in the volume rendering pipeline. In conventional tissue classification for a scalar volume, tissues of interest are characterized by an opacity transfer function defined as a one-dimensional (1D) function of the original volume intensity. To overcome the limitations inherent in conventional 1D opacity functions, we propose a tissue classification method that employs a multidimensional opacity function, which is a function of the 3D derivative features calculated from a scalar volume as well as the volume intensity. Tissues of interest are characterized by explicitly defined classification rules based on 3D filter responses highlighting local structures, such as edge, sheet, line, and blob, which typically correspond to tissue boundaries, cortices, vessels, and nodules, respectively, in medical volume data. The 3D local structure filters are formulated using the gradient vector and Hessian matrix of the volume intensity function combined with isotropic Gaussian blurring. These filter responses and the original intensity define a multidimensional feature space in which multichannel tissue classification strategies are designed. The usefulness of the proposed method is demonstrated by comparisons with conventional single-channel classification using both synthesized data and clinical data acquired with CT (computed tomography) and MRI (magnetic resonance imaging) scanners. The improvement in image quality obtained using multichannel classification is confirmed by evaluating the contrast and contrast-to-noise ratio in the resultant volume-rendered images with variable opacity values.

[1] M. Levoy, “Display of Surfaces from Volume Data,” IEEE Computer Graphics and Applications, vol. 8, no. 3, pp. 29-37, 1988.
[2] R.A. Drebin, L. Carpenter, and P. Hanrahan, “Volume Rendering,” Computer Graphics (SIGGRAPH '88 Proc.), no. 22, pp. 65-74, 1988.
[3] G.D. Rubin, C.F. Beullieu, V. Anngiro, H. Ringle, A.M. Norbash, J.F. Feller, M.D. Dake, R.B. Jefferey, and S. Naple, “Perspective Volume Rendering of CT and MR Images: Applications for Endoscopic Imaging,” Radiology, vol. 199, no. 2, pp. 321-330, 1996.
[4] P.T. Johnson, D.G. Heath, B.S. Kuszyk, and E.K. Fishman, “CT Angiography with Volume Rendering: Advantages and Applications in Splanchnic Vascular Imaging,” Radiology, vol. 200, no. 2, pp. 564-568, 1996.
[5] C. Barillot, “Surface and Volume Rendering Techniques to Display 3-D Data,” IEEE Eng. in Medicine and Biology, vol. 12, pp. 111-119, 1993.
[6] M.W. Vannier, R.L. Butterfield, D. Jordon, W.A. Murphy, R.G. Levitt, and M. Gado, “Multispectral Analysis of Magnetic Resonance Images,” Radiology, vol. 154, no. 1, pp. 221-224, 1985.
[7] M.C. Clark, L.O. Hall, D.B. Goldgof, L.P. Clarke, R.P. Velthuizen, and M.S. Silbiger, “MRI Segmentation Using Fuzzy Clustering Techniques,” IEEE Eng. in Medicine and Biology, vol. 13, pp. 730-742, 1994.
[8] Y. Sato, C.-F. Westin, A. Bhalerao, S. Nakajima, N. Shiraga, S. Yoshida, and R. Kikinis, “Tissue Classification Based on 3D Local Intensity Structures for Volume Rendering,” Proc. Japanese Associ. Medical Imaging Technology Frontier '97, pp. 167-172. 1997. (Mpeg movies are available at vr_index.html).
[9] Y. Sato, S. Nakajima, H. Atsumi, T. Koller, G. Gerig, S. Yoshida, and R. Kikinis, “3D Multiscale Line Filter for Segmentation and Visualization of Curvilinear Structures in Medical Images,” Proc. Joint Conf. Computer Vision, Virtual Reality, and Robotics in Medicine and Medical Robotics and Computer-Assisted Surgery '97, pp. 213-222, 1997.
[10] Y. Sato, S. Nakajima, N. Shiraga, H. Atsumi, S. Yoshida, T. Koller, G. Gerig, and R. Kikinis, “Three-Dimensional Multiscale Line Filter for Segmentation and Visualization of Curvilinear Structures in Medical Images,” Medical Image Analysis, vol. 2, no. 2, pp. 143-168, 1998.
[11] H. Knutsson, “Representing Local Structure Using Tensors,” Proc. Sixth Scandinavian Conf. Image Analysis, pp. 244-251, 1989.
[12] C.-F. Westin, “A Tensor Framework for Multidimensional Signal Processing,” thesis no. 348, Linköping Univ., Sweden, 1994.
[13] T.M. Koller, G. Gerig, G. Szekely, and D. Dettwiler, “Multiscale Detection of Curvilinear Structures in 2-D and 3-D Image Data,” Proc. Fifth Int'l Conf. Computer Vision (ICCV '95), pp. 864-869, 1995.
[14] G. Kindlmann and J.W. Durkin, “Semi-Automatic Generation of Transfer Functions for Direct Volume Rendering,” Proc. 1998 Volume Visualization Symp., pp. 79-86, Oct. 1998.
[15] D.H. Laidlaw, K.W. Fleischer, and A.H. Barr, “Partial-Volume Bayesian Classification of Material Mixtures in MR Volume Data Using Voxel Histograms,” IEEE Trans. Image Processing, vol. 17, no. 1, pp. 74-86, 1998.
[16] R.M. Haralick, L.T. Watson, and T.J. Laffey, “The Topographic Primal Sketch,” Int'l J. Robotic Research, vol. 2, pp. 50-72, 1983.
[17] C.-F. Westin, S. Warfield, A. Bhalerao, L. Mui, J. Richolt, and R. Kikinis, “Tensor Controlled Local Structure Enhancement of CT Images for Bone Segmentation,” Proc. Int'l Conf. Medical Image Computing and Computer-Assisted Intervention '98, pp. 1,205-1,212, 1998.
[18] S. Yamamoto, M. Matsumoto, Y. Tateno, T. Iinuma, and T. Matsumoto, “Quoit Filter: A New filter Based on Mathematical Morphology to Extract the Isolated Shadow, and Its Application to Automatic Detection of Lung Cancer in X-Ray CT,” Proc. 13th Int'l Conf. Pattern Recognition (ICPR '96), vol. 2, pp. 3-7, 1996.
[19] D. Marr, Vision—A Computational Investigation into the Human Representation and Processing of Visual Information. New York: W.H. Freeman, 1982.
[20] T. Lindeberg, “On Scale Selection for Differential Operators,” Proc. Eighth Scandinavian Conf. Image Analysis, pp. 857-866, 1993.
[21] T. Lindeberg, “Edge Detection and Ridge Detection with Automatic Scale Selection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '96), pp. 465-470, 1996.
[22] N.M. Hylton, I. Simovsky, A.J. Li, and J.D. Hale, “Impact of Section Doubling on MR Angiography,” Radiology vol. 185, no. 3, pp. 899-902, 1992.
[23] Y.P. Du, D.L. Parker, W.L. Davis, and G. Cao, “Reduction of Partial-Volume Artifacts with Zero-Filled Interpolation in Three-Dimensional MR Angiography,” J. Magnetic Resonance Imaging vol. 4, no. 5, pp. 733-741, 1995.
[24] A. Kandel and S.C. Lee, Fuzzy Switching and Automata. New York: Crane Russak, 1979.
[25] W. Schroeder, K. Martin, and B. Lorensen, The Visualization Toolkit: An Object-Oriented Approach to 3D Graphics, second ed. Upper Saddle River, N.J.: Prentice Hall, 1998 (the visualization toolkit, at).
[26] P. Lacroute and M. Levoy, "Fast Volume Rendering Using a Shear-Warp Factorization of the Viewing Transformation," Proc. Siggraph 94, ACM Press, New York, pp. 451-458.
[27] D.G. Brown and S.J. Riederer, “Contrast to-Noise Ratios in Maximum Intensity Projection Images,” Magnetic Resonance in Medicine, vol. 23, no. 1, pp. 130-137, 1992.
[28] H.C. Schwickert, T.P. Roberts, A. Muhler, M. Stiskal, F. Demsar, and R.C. Brasch, “Angiographic Properties of Gd-DTPA-24-Cascade-Polymer—A New Macromolecular MR Contrast Agent,” European J. Radiology, vol. 20, no. 2, pp. 144-150, 1995.
[29] K.Y. Ho, M.W. de Haan, A.G. Kessels, P.J. Kitslaar, and J.M. van Engelshoven, “Peripheral Vascular Tree Stenoses: Detection with Subtracted and Nonsubtracted MR Angiography,” Radiology, vol. 206, no. 3, pp. 673-681, 1998.
[30] N. Shiraga, Y. Sato, E. Kohda, Y. Okada, K. Sato, T. Hasebe, K. Hiramatsu, R. Kikinis, and F.A. Jolesz, “Three Dimensional Display of the Osteosclerotic Lesion by Volume Rendering Method,” Nippon Acta Radiologica, vol. 58, no. 2, p. S84, 1998.
[31] P.S. Huppi, S. Warfield, R. Kikinis, P.D. Barnes, G.P. Zientara, F.A. Jolesz, M.K. Tsuji, and J.J. Volpe, “Quantitative Magnetic Resonance Imaging of Brain Development in Premature and Mature Newborns,” Annals Neurology, vol. 43, no. 2, pp. 224-235, 1998.
[32] A. Shimizu, J. Hasegawa, and J. Toriwaki, “Minimum Directional Difference Filter for Extraction of Circumscribed Shadows in Chest X-Ray Images and Its Characteristics,” IEICE Trans., vol. J-76D-II, no. 2, pp. 241-249. 1993.
[33] M.L. Giger, K.T. Bae, and H. MacMahon, “Computerized Detection of Pulmonary Nodules in Computed Tomography Images,” Investigative Radiology, vol. 24, no. 4, pp. 459-465, 1994.
[34] K. Kanazawa, M. Kubo, N. Niki, H. Satoh, H. Ohmatsu, K. Eguchi, and N. Moriyama, “Computer Aided Screening System for Lung Cancer Based on Helical CT Images,” Proc. Visualization in Biomedical Computing, pp. 223-228, 1996.
[35] S. Nakajima, H. Atsumi, R. Kikinis, T.M. Moriarty, D.C. Metcalf, F.A. Jolesz, and P.M. Black, “Use of Cortical Surface Vessel Registration for Image-Guided Neurosurgery,” Neurosurgery, vol. 40, no. 6, pp. 1,201-1,210, 1997.
[36] Y. Sato, T. Kubota, K. Nakanishi, N. Sugano, T. Nishii, K. Ohzono, H. Nakamura, O. Ochi, and S. Tamura, “Three-Dimensional Reconstruction and Quantification of Hip Joint Cartilages from Magnetic Resonance Images,” Proc. Int'l Conf. Medical Image Computing and Computer-Assisted Intervention '99, pp. 338-347, 1999.
[37] H. Hu, “Multi-Slice Helical CT: Scan and Reconstruction,” Medical Physics, vol. 26, no. 1, pp. 5-18, 1999.
[38] J. Hasegawa and J. Toriwaki, “Automated Construction of Image Processing Procedures Based on Positive and Negative Sample Figures,” Proc. Asian Conf. Computer Vision '93 (ACCV '93), pp. 573-578, 1993.
[39] A. Shimizu, X. Zhou, J. Hasegawa, and J. Toriwaki, “Automated Construction of Three Dimensional Image Processing Procedures by Pictorial Example,” Proc. 18th Int'l Conf. IEEE Eng. in Medicine and Biology Society (EMBS '96), no. 682, 1996.

Index Terms:
Volume visualization, image enhancement, medical image, 3D derivative feature, multiscale analysis, multidimensional opacity function, multichannel classification, partial volume effect.
Yoshinobu Sato, Carl-Fredrik Westin, Abhir Bhalerao, Shin Nakajima, Nobuyuki Shiraga, Shinichi Tamura, Ron Kikinis, "Tissue Classification Based on 3D Local Intensity Structures for Volume Rendering," IEEE Transactions on Visualization and Computer Graphics, vol. 6, no. 2, pp. 160-180, April-June 2000, doi:10.1109/2945.856997
Usage of this product signifies your acceptance of the Terms of Use.