The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.01 - Jan. (2013 vol.19)
pp: 81-93
Joong-Ho Won , Sch. of Ind. Manage. Eng., Korea Univ., Seoul, South Korea
Yongkweon Jeon , Dept. of Electr. & Comput. Eng., Seoul Nat. Univ., Seoul, South Korea
J. K. Rosenberg , Dept. of Radiol., Stanford Univ., Stanford, CA, USA
Sungroh Yoon , Dept. of Electr. & Comput. Eng., Seoul Nat. Univ., Seoul, South Korea
G. D. Rubin , Dept. of Radiol., Stanford Univ., Stanford, CA, USA
S. Napel , Dept. of Radiol., Stanford Univ., Stanford, CA, USA
ABSTRACT
Direct projection of 3D branching structures, such as networks of cables, blood vessels, or neurons onto a 2D image creates the illusion of intersecting structural parts and creates challenges for understanding and communication. We present a method for visualizing such structures, and demonstrate its utility in visualizing the abdominal aorta and its branches, whose tomographic images might be obtained by computed tomography or magnetic resonance angiography, in a single 2D stylistic image, without overlaps among branches. The visualization method, termed uncluttered single-image visualization (USIV), involves optimization of geometry. This paper proposes a novel optimization technique that utilizes an interesting connection of the optimization problem regarding USIV to the protein structure prediction problem. Adopting the integer linear programming-based formulation for the protein structure prediction problem, we tested the proposed technique using 30 visualizations produced from five patient scans with representative anatomical variants in the abdominal aortic vessel tree. The novel technique can exploit commodity-level parallelism, enabling use of general-purpose graphics processing unit (GPGPU) technology that yields a significant speedup. Comparison of the results with the other optimization technique previously reported elsewhere suggests that, in most aspects, the quality of the visualization is comparable to that of the previous one, with a significant gain in the computation time of the algorithm.
INDEX TERMS
proteins, biomedical MRI, computerised tomography, data visualisation, geometry, graphics processing units, integer programming, linear programming, medical image processing, parallel processing, GPU, uncluttered single-image visualization, vascular structures, GPGPU technology, general-purpose graphics processing unit technology, commodity-level parallelism, abdominal aortic vessel tree, anatomical variants, protein structure prediction problem, geometry optimization technique, USIV, 2D stylistic image, magnetic resonance angiography, computed tomography, tomographic images, abdominal aorta visualization, structure visualization, 3D branching structures direct projection, integer linear programming-based formulation, Visualization, Three dimensional displays, Biomedical imaging, Optimization, Context, Solid modeling, Graphics processing unit, CUDA, proteins, biomedical MRI, computerised tomography, data visualisation, geometry, graphics processing units, integer programming, linear programming, medical image processing, parallel processing, GPU, uncluttered single-image visualization, vascular structures, GPGPU technology, general-purpose graphics processing unit technology, commodity-level parallelism, abdominal aortic vessel tree, anatomical variants, protein structure prediction problem, geometry optimization technique, USIV, 2D stylistic image, magnetic resonance angiography, computed tomography, tomographic images, abdominal aorta visualization, structure visualization, 3D branching structures direct projection, integer linear programming-based formulation, Visualization, Three dimensional displays, Biomedical imaging, Optimization, Context, Solid modeling, Graphics processing unit, parallelization, Single-image visualization, abdominal aorta, side-chain placement, integer linear programming, GPGPU
CITATION
Joong-Ho Won, Yongkweon Jeon, J. K. Rosenberg, Sungroh Yoon, G. D. Rubin, S. Napel, "Uncluttered Single-Image Visualization of Vascular Structures Using GPU and Integer Programming", IEEE Transactions on Visualization & Computer Graphics, vol.19, no. 1, pp. 81-93, Jan. 2013, doi:10.1109/TVCG.2012.25
REFERENCES
[1] J. Won, J. Rosenberg, G.D. Rubin, and S. Napel, "Uncluttered Single-Image Visualization of the Abdominal Aortic Vessel Tree: Method and Evaluation," Medical Physics, vol. 36, no. 11, pp. 5245-5260, Nov. 2009.
[2] M. Tory, A.E. Kirkpatrick, M.S. Atkins, and T. Möller, "Visualization Task Performance with 2D, 3D, and Combination Displays," IEEE Trans. Visualization and Computer Graphics, vol. 12, no. 1, pp. 2-13, Jan./Feb. 2006.
[3] A. Kanitsar, R. Wegenkittl, D. Fleischmann, and M.E. Gröller, "Advanced Curved Planar Reformation: Flattening of Vascular Structures," Proc. 14th IEEE Conf. Visualization, pp. 43-50, Oct. 2003.
[4] R. Raman, S. Napel, C.F. Beaulieu, E.S. Bain, R.B. JeffreyJr., and G.D. Rubin, "Automated Generation of Curved Planar Reformations from Volume Data," Radiology, vol. 223, no. 1, pp. 275-80, 2002.
[5] X. Lan and D.P. Huttenlocher, "Beyond Trees: Common-factor Models for 2D Human Pose Recovery," ICCV '05: Proc. 10th IEEE Int'l Conf. Computer Vision, vol. 1, pp. 470-477, 2005.
[6] X. Ren, A. Berg, and J. Malik, "Recovering Human Body Configurations Using Pairwise Constraints between Parts," Proc. 10th IEEE Int'l Conf. Computer Vision, vol. 1, pp. 824-831, Oct. 2005.
[7] A. Gupta, A. Mittal, and L. Davis, "Constraint Integration for Efficient Multiview Pose Estimation with Self-Occlusions," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 3, pp. 493-506, Mar. 2008.
[8] O. Karpenko, W. Li, N. Mitra, and M. Agrawala, "Exploded View Diagrams of Mathematical Surfaces," IEEE Trans. Visualization and Computer Graphics, vol. 16, no. 6, pp. 1311-1318, Nov./Dec. 2010.
[9] W. Li, M. Agrawala, B. Curless, and D. Salesin, "Automated Generation of Interactive 3D Exploded View Diagrams," Proc. ACM SIGGRAPH, pp. 1-7, 2008.
[10] M. Agrawala, D. Phan, J. Heiser, J. Haymaker, J. Klingner, P. Hanrahan, and B. Tversky, "Designing Effective Step-by-Step Assembly Instructions," ACM Trans. Graphics, vol. 22, no. 3, pp. 828-837, 2003.
[11] C. Ware and P. Mitchell, "Visualizing Graphs in Three Dimensions," ACM Trans. Applied Perception, vol. 5, no. 1, pp. 1-15, 2008.
[12] C. Ware and P. Mitchell, "Reevaluating Stereo and Motion Cues for Visualizing Graphs in Three Dimensions," Proc. Second Symp. Applied Perception in Graphics and Visualization, pp. 51-58, 2005.
[13] A.V. Bartrolí, R. Wegenkittl, A. König, and E. Gröller, "Nonlinear Virtual Colon Unfolding," Proc. IEEE Conf. Visualization, pp. 411-420, 2001.
[14] L. Zhu, S. Haker, and A. Tannenbaum, "Flattening Maps for the Visualization of Multibranched Vessels," IEEE Trans. Medical Imaging, vol. 24, no. 2, pp. 191-198, Feb. 2005.
[15] M. Termeer, J.O. Bescós, M. Breeuwer, A. Vilanova, F. Gerritsen, and M.E. Gröller, "CoViCAD: Comprehensive Visualization of Coronary Artery Disease," IEEE Trans. Visualization and Computer Graphics, vol. 13, no. 6, pp. 1632-1639, Nov./Dec. 2007.
[16] T. Ropinski, S. Hermann, R. Reich, M. Schafers, and K. Hinrichs, "Multimodal Vessel Visualization of Mouse Aorta PET/CT Scans," IEEE Trans. Visualization and Computer Graphics, vol. 15, no. 6, pp. 1515-1522, Nov./Dec. 2009.
[17] S. Oeltze and B. Preim, "Visualization of Vasculature with Convolution Surfaces: Method, Validation and Evaluation," IEEE Trans. Medical Imaging, vol. 24, no. 4, pp. 540-548, Apr. 2005.
[18] H. Hahn, B. Preim, D. Selle, and H. Peitgen, "Visualization and Interaction Techniques for the Exploration of Vascular Structures," Proc. 11th IEEE Conf. Visualization, pp. 395-402, 2001.
[19] T. Deschamps, "Extraction de Courbes et Sufaces par méthodes de Chemins Minimaux et Ensembles de Niveaux. Applications en Imagerie Medicale 3D," PhD dissertation, L'université de Paris-Dauphine, 2001.
[20] L. Antiga, "Patient-Specific Modeling of Geometry and Blood-Flow in Large Arteries," PhD dissertation, Politecnico di Milano, 2003.
[21] M. Levitt and A. Warshel, "Computer Simulation of Protein Folding," Nature, vol. 253, no. 5494, pp. 694-698, 1975.
[22] C. Yanover and Y. Weiss, "Approximate Inference and Protein-Folding," Advances in Neural Information Processing Systems, S. Becker, S. Thrun, and K. Obermayer, eds., vol. 15, pp. 1457-1464, 2002.
[23] D.B. Gordon, S.A. Marshall, and S.L. Mayo, "Energy Functions for Protein Design," Current Opinion in Structural Biology, vol. 9, no. 4, pp. 509-513, 1999.
[24] R.L. DunbrackJr. and M. Karplus, "Conformational Analysis of the Backbone-Dependent Rotamer Preferences of Protein Sidechains," Nature Structural Biology, vol. 1, no. 5, pp. 334-340, 1994.
[25] H.M. Berman, J. Westbrook, Z. Feng, G. Gilliland, T.N. Bhat, H. Weissig, I.N. Shindyalov, and P.E. Bourne, "The Protein Data Bank," Nucleic Acids Research, vol. 28, no. 1, pp. 235-242, 2000.
[26] C.L. Kingsford, B. Chazelle, and M. Singh, "Solving and Analyzing Side-Chain Positioning Problems Using Linear and Integer Programming," Bioinformatics, vol. 21, no. 7, pp. 1028-1036, 2005.
[27] J. Christensen, J. Marks, and S. Shieber, "An Empirical Study of Algorithms for Point-Feature Label Placement," ACM Trans. Graphics, vol. 14, no. 3, pp. 203-232, July 1995.
[28] IBM, "IBM ILOG CPLEX Optimizer," 2011.
[29] D. Bertsimas and R. Shioda, "Classification and Regression via Integer Optimization," Operations Research, vol. 55, no. 2, pp. 252-271, Mar. 2007.
[30] J. Sanders and E. Kandrot, CUDA by Example: An Introduction to General-Purpose GPU Programming. Addison-Wesley, 2010.
[31] L. Antiga, "VMTK - Vascular Modeling Toolkit," 2006.
[32] F. Wilcoxon, "Individual Comparisons by Ranking Methods," Biometrics Bull., vol. 1, no. 6, pp. 80-83, 1945.
[33] S. Wellek, Testing Statistical Hypotheses of Equivalence and Noninferiority. Chapman & Hall, 2010.
[34] J. Won, "Uncluttered Single-Image Visualization of the Abdominal Aortic Vessel Tree Using Global Optimization Methods," PhD dissertation, Stanford Univ., Jan. 2009.
[35] M.A. Bekos, M. Kaufmann, A. Symvonis, and A. Wolff, "Boundary Labeling: Models and Efficient Algorithms for Rectangular Maps," Proc. Int'l Symp. Graph Drawing, J. Pach, ed., pp. 49-59, 2005.
[36] T. Stein and X. De'coret, "Dynamic Label Placement for Improved Interactive Exploration," Proc. Sixth Int'l Symp. Non-Photorealistic Animation and Rendering, pp. 15-21, 2008.
[37] M. Nollenburg and A. Wolff, "Drawing and Labeling High-Quality Metro Maps by Mixed-Integer Programming," IEEE Trans. Visualization and Computer Graphics, vol. 17, no. 5, pp. 626-641, May 2011.
[38] E.-J. Hong and T. Lozano-Pérez, "Protein Side-Chain Placement through Map Estimation and Problem-Size Reduction," Proc. Workshop Algorithms in Bioinformatics, pp. 219-230, 2006.
[39] S. Canzar, N.C. Toussaint, and G.W. Klau, "An Exact Algorithm for Side-Chain Placement in Protein Design," Optimization Letters, vol. 5, pp. 393-406, Mar. 2011.
29 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool