This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Interactive Histology of Large-Scale Biomedical Image Stacks
November/December 2010 (vol. 16 no. 6)
pp. 1386-1395
Won-Ki Jeong, Harvard University
Jens Schneider, King Abdullar University of Science and Technology
Stephen Turney, Harvard University
Beverly E Faulkner-Jones, BIDMC Pathology and Harvard Medical School
Dominik Meyer, Technische Universität München
Rüdiger Westermann, Technische Universität München
R. Clay Reid, Harvard Medical School
Jeff Lichtman, Harvard University
Hanspeter Pfister, Harvard University
Histology is the study of the structure of biological tissue using microscopy techniques. As digital imaging technology advances, high resolution microscopy of large tissue volumes is becoming feasible; however, new interactive tools are needed to explore and analyze the enormous datasets. In this paper we present a visualization framework that specifically targets interactive examination of arbitrarily large image stacks. Our framework is built upon two core techniques: display-aware processing and GPU-accelerated texture compression. With display-aware processing, only the currently visible image tiles are fetched and aligned on-the-fly, reducing memory bandwidth and minimizing the need for time-consuming global pre-processing. Our novel texture compression scheme for GPUs is tailored for quick browsing of image stacks. We evaluate the usability of our viewer for two histology applications: digital pathology and visualization of neural structure at nanoscale-resolution in serial electron micrographs.

[1] A. C. Beers, M. Agrawala, and N. Chaddha, Rendering from compressed textures. In Proc. SIGGRAPH '96, pages 373–378, 1996.
[2] D. Benson and J. Davis, Octree textures. In Proc. SIGGRAPH '02, pages 785–790, 2002.
[3] M. J. Berger and J. Oliger, Adaptive Mesh Refinement for Hyperbolic Partial Differential Equations. Journal of Computational Physics, 53: 484–512, Mar. 1984.
[4] P. J. Burt and E. H. Adelson, The laplacian pyramid as a compact image code. IEEE Transactions on Communications, 31: 532–540, 1983.
[5] N. Fout and K.-L. Ma, Transform coding for hardware-accelerated volume rendering. IEEE Transactions on Visualization and Computer Graphics, 13 (6): 1600 1607, November 2007.
[6] N. Fout, K.-L. Ma, and J. Ahrens, Time-varying, multivariate volume data reduction. In Proceedings of the ACM Symposium on Applied Computing, pages 1224–1230, 2005.
[7] S. F. Frisken, R. N. Perry, A. P. Rockwood, and T. R. Jones, Adaptively sampled distance fields: a general representation of shape for computer graphics. In Proc. SIGGRAPH '00, pages 249–254, 2000.
[8] A. Gersho and R. M. Gray, Vector Quantization and Signal Compression. Kluwer Academic Press, 1st edition, 1991.
[9] M. H. Ghavamnia and X. D. Yang, Direct rendering of laplacian pyramid compressed volume data. In Proceedings of IEEE Visualization, pages 192–199, 1995.
[10] GigaPan.http://www.gigapan.org.
[11] J. Gilbertson and Y. Yagi, Histology, imaging and new diagnostic workflows in pathology. Diagnostic Pathology, 3 (Suppl): S14, Jan 2008.
[12] R. M. Gray and D. L. Neuhoff, Quantization. IEEE Transactions on Information Theory, 44 (6): 2325–2383, 1998.
[13] S. Guthe and W. Straßer, Real-time decompression and visualization of animated volume data. In IEEE Visualization, pages 349–356, 2001.
[14] S. Guthe, M. Wand, J. Gonser, and W. Straßer, Interactive rendering of large volume data sets. In IEEE Visualization, pages 53–60, 2002.
[15] E. Haber and J. Modersitzki, Numerical methods for image registration. Inverse Problems, 24, 2004.
[16] J. Ho, A. Parwani, D. Jukic, Y. Yagi, and L. Anthony, Use of whole slide imaging in surgical pathology quality assurance: design and pilot validation studies. Human pathology, 37: 322–331, Jan 2006.
[17] Aperio image scope. http: //www. aperio . com/pathology-services images cope-slide-viewing-software.asp.
[18] J. Kopf, M. Uyttendaele, O. Deussen, and M. F. Cohen, Capturing and viewing gigapixel images. ACM Transactions on Graphics, 26 (3): 93:1–93:10, July 2007.
[19] M. Kraus and M. Strengert, Pyramid filters based on bilinear interpolation. In Proceedings GRAPP 2007, pages 21–28, 2007.
[20] Krieken, M. G. Rojo, I. Moreno, A. Ariza, and S. Tuzlali, A European network for virtual microscopy—design, implementation and evaluation of performance. Virchows Archiv, 454 (4): 421–429, Jan 2009.
[21] E. Krupinski, A. Tillack, L. Richter, and J. Henderson, Eye-movement study and human performance using telepathology virtual slides. implications for medical education and differences with experience. Human pathology, 37: 1543–1556, Jan 2006.
[22] Y. Linde, A. Buzo, and R. Gray, An algorithm for vector quantizer design. IEEE Transactions on Communications, 28: 84–94, 1980.
[23] P. Ljung, C. Lundström, A. Ynnerman, and K. Museth, Transfer function based adaptive decompression for volume rendering of large medical data sets. In IEEE Symposium on Volume Visualization and Graphics, pages 25–32, 2004.
[24] S. P. Lloyd, Least squares quantization in PCM. IEEE Transactions on Information Theory, 28: 129–137, March 1982.
[25] E. Lum, K.-L. Ma, and J. Clyne, Texture hardware assisted rendering of time-varying volume data. In IEEE Visualization, pages 263–270, 2001.
[26] K.-L. Ma and H.-W. Shen, Compression and accelerated rendering of time-varying volume data. In Proceedings of the International Computer Symposium—Workshop on Computer Graphics and Virtual Reality, pages 82–89, 2000.
[27] Microsoft HD view. http://research.microsoft.com/en-us/um/ redmond/ groups/ivm/HDView.
[28] D. Nagayasu, F. Ino, and K. Hagihara, A decompression pipeline for accelerating out-of-core volume rendering of time-varying data. Computers & Graphics, 32 (3): 350–362, June 2008.
[29] NDP.view.http://sales.hamamatsu.com/de/produkte/system- divis ion/ virtual-micros copy/products software.php.
[30] P. Ning and L. Hesselink, Vector quantization for volume rendering. In Proceedings of the Workshop on Volume Visualization, pages 69–74, 1992.
[31] Oberhumer.com. LZO real-time data compression library. http://www. oberhumer.com/opensource/lzo .
[32] K. Sayood, Introduction to Data Compression. Morgan Kaufmann, 2nd edition, 2000.
[33] J. Schneider, Kompressions- und Darstellungsverfahren für hochaufgelöste Volumendaten. Diploma thesis, RWTH Aachen, Germany, 2003. http://wwwcg.in.tum.deResearch(English).
[34] J. Schneider and R. Westermann, Compression domain volume rendering. In Proceedings of IEEE Visualization, pages 293–300, 2003.
[35] Seadragon.http://www.seadragon.com.
[36] H.-W. Shen and C. R. Johnson, Differential volume rendering: A fast volume visualization technique for flow animation. In IEEE Visualization, pages 180–187, 1994.
[37] C. Wang, H. Yu, and K.-L. Ma, Application-driven compression for visualizing large-scale time-varying data. IEEE Computer Graphics and Applications, 30 (1): 59–69, 2010.
[38] R. Westermann, Compression domain rendering of time-resolved volume data. In IEEE Visualization 1995, pages 168–175, 1995.
[39] J. Wilhelms and A. V. Gelder, Multi-dimensional trees for controlled volume rendering and compression. In In Proceedings of the 1994 Symposium on Volume Visualization, pages 27–34, 1994.

Index Terms:
Gigapixel viewer, biomedical image processing, GPU, texture compression
Citation:
Won-Ki Jeong, Jens Schneider, Stephen Turney, Beverly E Faulkner-Jones, Dominik Meyer, Rüdiger Westermann, R. Clay Reid, Jeff Lichtman, Hanspeter Pfister, "Interactive Histology of Large-Scale Biomedical Image Stacks," IEEE Transactions on Visualization and Computer Graphics, vol. 16, no. 6, pp. 1386-1395, Nov.-Dec. 2010, doi:10.1109/TVCG.2010.168
Usage of this product signifies your acceptance of the Terms of Use.