This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Interactive Slice WIM: Navigating and Interrogating Volume Data Sets Using a Multisurface, Multitouch VR Interface
Oct. 2012 (vol. 18 no. 10)
pp. 1614-1626
ASCII Text
x 
 
Dane Coffey, Nicholas Malbraaten, Trung Bao Le, Iman Borazjani, Fotis Sotiropoulos, Arthur G. Erdman, Daniel F. Keefe, "Interactive Slice WIM: Navigating and Interrogating Volume Data Sets Using a Multisurface, Multitouch VR Interface," IEEE Transactions on Visualization and Computer Graphics, vol. 18, no. 10, pp. 1614-1626, Oct., 2012.
 
 
BibTex
x
 
@article{ 10.1109/TVCG.2011.283,
author = {Dane Coffey and Nicholas Malbraaten and Trung Bao Le and Iman Borazjani and Fotis Sotiropoulos and Arthur G. Erdman and Daniel F. Keefe},
title = {Interactive Slice WIM: Navigating and Interrogating Volume Data Sets Using a Multisurface, Multitouch VR Interface},
journal ={IEEE Transactions on Visualization and Computer Graphics},
volume = {18},
number = {10},
issn = {1077-2626},
year = {2012},
pages = {1614-1626},
doi = {http://doi.ieeecomputersociety.org/10.1109/TVCG.2011.283},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - JOUR
JO - IEEE Transactions on Visualization and Computer Graphics
TI - Interactive Slice WIM: Navigating and Interrogating Volume Data Sets Using a Multisurface, Multitouch VR Interface
IS - 10
SN - 1077-2626
SP1614
EP1626
EPD - 1614-1626
A1 - Dane Coffey,
A1 - Nicholas Malbraaten,
A1 - Trung Bao Le,
A1 - Iman Borazjani,
A1 - Fotis Sotiropoulos,
A1 - Arthur G. Erdman,
A1 - Daniel F. Keefe,
PY - 2012
KW - Three dimensional displays
KW - Data visualization
KW - Navigation
KW - Stereo image processing
KW - Two dimensional displays
KW - Solid modeling
KW - 3D user interface.
KW - World in miniature
KW - virtual reality
KW - multitouch
KW - overview+detail
KW - volume visualization
VL - 18
JA - IEEE Transactions on Visualization and Computer Graphics
ER -
 
Dane Coffey, University of Minnesota, Minneapolis
Nicholas Malbraaten, University of Minnesota, Minneapolis
Trung Bao Le, University of Minnesota, Minneapolis
Iman Borazjani, SUNY University at Buffalo, Buffalo
Fotis Sotiropoulos, University of Minnesota, Minneapolis
Arthur G. Erdman, University of Minnesota, Minneapolis
Daniel F. Keefe, University of Minnesota, Minneapolis
We present Interactive Slice World-in-Miniature (WIM), a framework for navigating and interrogating volumetric data sets using an interface enabled by a virtual reality environment made of two display surfaces: an interactive multitouch table, and a stereoscopic display wall. The framework addresses two current challenges in immersive visualization: 1) providing an appropriate overview+detail style of visualization while navigating through volume data, and 2) supporting interactive querying and data exploration, i.e., interrogating volume data. The approach extends the WIM metaphor, simultaneously displaying a large-scale detailed data visualization and an interactive miniature. Leveraging the table+wall hardware, horizontal slices are projected (like a shadow) down onto the table surface, providing a useful 2D data overview to complement the 3D views as well as a data context for interpreting 2D multitouch gestures made on the table. In addition to enabling effective navigation through complex geometries, extensions to the core Slice WIM technique support interacting with a set of multiple slices that persist on the table even as the user navigates around a scene and annotating and measuring data via points, paths, and volumes specified using interactive slices. Applications of the interface to two volume data sets are presented, and design decisions, limitations, and user feedback are discussed.

[1] Mimics Software, http://www.materialise.commimics, 2011.
[2] The Nat'l Library of Medicine's Visible Human Project, http://www.nlm.nih.gov/research/visiblevisible_human.html , 2011.
[3] D. Akers, "CINCH: A Cooperatively Designed Marking Interface for 3D Pathway Selection," Proc. 19th Ann. ACM Symp. User Interface Software and Technology, pp. 33-42, 2006.
[4] M.Q.W. Baldonado, A. Woodruff, and A. Kuchinsky, "Guidelines for Using Multiple Views in Information Visualization," Proc. Working Conf. Advanced Visual Interfaces, pp. 110-119, 2000.
[5] P. Baudisch, N. Good, V. Bellotti, and P. Schraedley, "Keeping Things in Context: A Comparative Evaluation of Focus Plus Context Screens, Overviews, and Zooming," Proc. Conf. Human Factors in Computing Systems Changing Our World Changing Ourselves, pp. 259-266, 2002.
[6] P. Baudisch, N. Good, and P. Stewart, "Focus Plus Context Screens: Combining Display Technology with Visualization Techniques," Proc. 14th Ann. ACM Symp. User Interface Software and Technology, pp. 31-40, 2001.
[7] H. Benko and S. Feiner, "Balloon Selection: A Multi-Finger Technique for Accurate Low-Fatigue 3D Selection," Proc. IEEE Symp. 3D User Interfaces (3DUI '07), 2007.
[8] I. Borazjani, L. Ge, and F. Sotiropoulos, "High-Resolution Fluid-Structure Interaction Simulations of Flow through a Bi-Leaflet Mechanical Heart Valve in an Anatomic Aorta," Annals of Biomedical Eng., vol. 38, no. 2, pp. 326-344, Feb. 2010.
[9] I. Borazjani and F. Sotiropoulos, "The Effect of Implantation Orientation of a Bileaflet Mechanical Heart Valve on Kinematics and Hemodynamics in an Anatomic Aorta," J. Biomechanical Eng., vol. 132, no. 11, p. 111005, Nov. 2010.
[10] S. Bryson, "Virtual Reality in Scientific Visualization," Comm. the ACM, vol. 39, no. 5, pp. 62-71, 1996.
[11] T. Butkiewicz, W. Dou, Z. Wartell, W. Ribarsky, and R. Chang, "Multi-Focused Geospatial Analysis Using Probes," IEEE Trans. Visualization and Computer Graphics, vol. 14, no. 6, pp. 1165-1172, Nov./Dec. 2008.
[12] A. Cockburn, A. Karlson, and B.B. Bederson, "A Review of Overview+Detail, Zooming, and Focus+Context Interfaces," ACM Computing Surveys, vol. 41, no. 1, pp. 1-31, 2008.
[13] D. Coffey, F. Korsakov, and D.F. Keefe, "Low Cost VR Meets Low Cost Multi-Touch," Proc. Int'l Symp. Visual Computing, pp. 351-360, 2010.
[14] D. Coffey, N. Malbraaten, T. Le, I. Borazjani, F. Sotiropoulos, D. niel, and F. Keefe, "Slice WIM: A Multi-Surface, Multi-Touch Interface for Overview+Detail Exploration of Volume Data Set in Virtual Reality," Proc. ACM SIGGRAPH, 2011.
[15] M.J. Flider and B.P. Bailey, "An Evaluation of Techniques for Controlling Focus+Context Screens," Proc. Graphics Interface, pp. 135-144, 2004.
[16] T. Grossman and R. Balakrishnan, "The Design and Evaluation of Selection Techniques for 3D Volumetric Displays," Proc. 19th Ann. ACM Symp. User Interface Software and Technology, pp. 3-12, 2006.
[17] M. Hachet and P. Guitton, "The Interaction Table: A New Input Device Designed for Interaction in Immersive Large Display Environments," Proc. Workshop Virtual Environments, pp. 189-196, 2002.
[18] J.Y. Han, "Low-Cost Multi-Touch Sensing through Frustrated Total Internal Reflection," Proc. 18th Ann. ACM Symp. User Interface Software and Technology, pp. 115-118, 2005.
[19] B. Hentschel, I. Tedjo, M. Probst, M. Wolter, M. Behr, C. Bischof, and T. Kuhlen, "Interactive Blood Damage Analysis for Ventricular Assist Devices," IEEE Trans. Visualization and Computer Graphics, vol. 14, no. 6, pp. 1515-1522, Nov./Dec. 2008.
[20] K.P. Herndon, R.C. Zeleznik, D.C. Robbins, D.B. Conner, S.S. Snibbe, and A. van Dam, "Interactive Shadows," Proc. Fifth Ann. ACM Symp. User Interface Software and Technology (UIST '92), pp. 1-6, 1992.
[21] E. Hornecker, P. Marshall, N.S. Dalton, and Y. Rogers, "Collaboration and Interference: Awareness with Mice or Touch Input," Proc. ACM Conf. Computer Supported Cooperative Work, pp. 167-176, 2008.
[22] M.S. John, M.B. Cowen, H.S. Smallman, and H.M. Oonk, "The Use of 2D and 3D Displays for Shape-Understanding Versus Relative-Position Tasks," Human Factors, vol. 43, no. 1, pp. 79-98, 2001.
[23] D. Keefe, R. Zeleznik, and D. Laidlaw, "Tech-Note: Dynamic Dragging for Input of 3D Trajectories," 2008.
[24] K. Kin, M. Agrawala, and T. DeRose, "Determining the Benefits of Direct-Touch, Bimanual, and Multifinger Input On a Multitouch Workstation," Proc. Graphics Interface, pp. 119-124, 2009.
[25] W. Kruger, C. Bohn, B. Frhlich, H. Schth, W. Strauss, and G. Wesche, "The Responsive Workbench," IEEE Computer Graphics and Applications, vol. 14, no. 3, pp. 12-15, May 1994.
[26] J.J.J. LaViola, D.A. Feliz, D.F. Keefe, and R.C. Zeleznik, "Hands-Free Multi-Scale Navigation in Virtual Environments," Proc. Symp. Interactive 3D Graphics, pp. 9-15, 2001.
[27] T. Le, I. Borazjani, and F. Sotiropoulos, "A Computational Framework for High Resolution Simulations of Patient-Specific Left Heart Hemodynamics with Aortic Valve Prothesis," Proc. Cardiovascular Fluid Mechanics (CVFM '11), June 2011.
[28] Y. Li, C.-W. Fu, and A. Hanson, "Scalable wim: Effective Exploration in Large-Scale Astrophysical Environments," IEEE Trans. Visualization and Computer Graphics, vol. 12, no. 5, pp. 1005-1012, Sept./Oct. 2006.
[29] R. Pausch, T. Burnette, D. Brockway, and M.E. Weiblen, "Navigation and Locomotion in Virtual Worlds via Flight into Hand-Held Miniatures," Proc. 22nd Ann. Conf. Computer Graphics and Interactive Techniques, pp. 399-400, 1995.
[30] J.S. Pierce, B.C. Stearns, and R. Pausch, "Voodoo Dolls," Proc. Symp. Interactive 3D Graphics (SI3D '99), pp. 141-145, 1999.
[31] H. Piringer, R. Kosara, and H. Hauser, "Interactive Focus+Context Visualization with Linked 2D/3D Scatterplots," Proc. Second Int'l Conf. Coordinated and Multiple Views in Exploratory Visualization, pp. 49-60, 2004.
[32] G. Robles-De-La-Torre, "The Importance of the Sense of Touch in Virtual and Real Environments," IEEE MultiMedia, vol. 13, no. 3, pp. 24-30, July-Sept. 2006.
[33] J.S. Sobel, A.S. Forsberg, D.H. Laidlaw, R.C. Zeleznik, D.F. Keefe, I. Pivkin, G.E. Karniadakis, P. Richardson, and S. Swartz, "Particle Flurries: Synoptic 3D Pulsatile Flow Visualization," IEEE Computer Graphics and Applications, vol. 24, no. 2, pp. 76-85, Apr. 2004.
[34] M. Spindler, S. Stellmach, and R. Dachselt, "PaperLens: Advanced Magic Lens Interaction above the Tabletop," Proc. ACM Int'l Conf. Interactive Tabletops and Surfaces, pp. 69-76, 2009.
[35] R. Stoakley, M.J. Conway, and R. Pausch, "Virtual Reality on a WIM: Interactive Worlds in Miniature," Proc. SIGCHI Conf. Human Factors in Computing Systems, pp. 265-272, 1995.
[36] M. Tory, A.E. Kirkpatrick, M.S. Atkins, and T. Moller, "Visualization Task Performance with 2D, 3D, and Combination Displays," IEEE Trans. Visualization and Computer Graphics, vol. 12, no. 1, pp. 2-13, Jan./Feb. 2006.
[37] R. Trueba, C. Andujar, and F. Argelaguet, "Complexity and Occlusion Management for the World-in-Miniature Metaphor," Proc. 10th Int'l Symp. Smart Graphics, pp. 155-166, 2009.
[38] D. Valkov, F. Steinicke, G. Bruder, K. Hinrichs, J. Schoning, F. Daiber, and A. Kruger, "Touching Floating Objects in Projection-Based Virtual Reality Environments," Proc. Joint Virtual Reality Conf. (VSBHSDK '10), 2010.
[39] C. Ware and P. Mitchell, "Visualizing Graphs in Three Dimensions," ACM Trans. Applied Perception, vol. 5, pp. 1-15, Jan. 2008.
[40] D. Wigdor, C. Shen, C. Forlines, and R. Balakrishnan, "Table-Centric Interactive Spaces for Real-Time Collaboration," Proc. Working Conf. Advanced Visual Interfaces, pp. 103-107, 2006.
[41] C.A. Wingrave, Y. Haciahmetoglu, and D.A. Bowman, "Overcoming World in Miniature Limitations by a Scaled and Scrolling WIM," Proc. IEEE Conf. Virtual Reality, pp. 11-16, 2006.
[42] L. Yu, P. Svetachov, P. Isenberg, M.H. Everts, and T. Isenberg, "FI3D: Direct-Touch Interaction for the Exploration of 3D Scientific Visualization Spaces," IEEE Trans. Visualization and Computer Graphics, vol. 16, no. 6, pp. 1613-1622, Nov./Dec. 2010.

Index Terms:
Three dimensional displays,Data visualization,Navigation,Stereo image processing,Two dimensional displays,Solid modeling,3D user interface.,World in miniature,virtual reality,multitouch,overview+detail,volume visualization
Citation:
Dane Coffey, Nicholas Malbraaten, Trung Bao Le, Iman Borazjani, Fotis Sotiropoulos, Arthur G. Erdman, Daniel F. Keefe, "Interactive Slice WIM: Navigating and Interrogating Volume Data Sets Using a Multisurface, Multitouch VR Interface," IEEE Transactions on Visualization and Computer Graphics, vol. 18, no. 10, pp. 1614-1626, Oct. 2012, doi:10.1109/TVCG.2011.283
Usage of this product signifies your acceptance of the Terms of Use.