This Article 
 Bibliographic References 
 Add to: 
The General Pinhole Camera: Effective and Efficient Nonuniform Sampling for Visualization
September/October 2010 (vol. 16 no. 5)
pp. 777-790
Voicu Popescu, Purdue University, West Lafayette
Paul Rosen, Purdue University, West Lafayette
Laura Arns, NAWCWD, Lethality Analysis, NAVAIR, China Lake
Xavier Tricoche, Purdue University, West Lafayette
Chris Wyman, The University of Iowa, Iowa City
Christoph M. Hoffmann, Purdue University, West Lafayette
We introduce the general pinhole camera (GPC), defined by a center of projection (i.e., the pinhole), an image plane, and a set of sampling locations in the image plane. We demonstrate the advantages of the GPC in the contexts of remote visualization, focus-plus-context visualization, and extreme antialiasing, which benefit from the GPC sampling flexibility. For remote visualization, we describe a GPC that allows zooming-in at the client without the need for transferring additional data from the server. For focus-plus-context visualization, we describe a GPC with multiple regions of interest with sampling rate continuity to the surrounding areas. For extreme antialiasing, we describe a GPC variant that allows supersampling locally with a very high number of color samples per output pixel (e.g., 1,024{\times}), supersampling levels that are out of reach for conventional approaches that supersample the entire image. The GPC supports many types of data, including surface geometry, volumetric, and image data, as well as many rendering modes, including highly view-dependent effects such as volume rendering. Finally, GPC visualization is efficient—GPC images are rendered and resampled with the help of graphics hardware at interactive rates.

[1] C.R. Johnson, R. Moorhead, T. Munzner, H. Pfister, P. Rheingans, and T.S. Yoo, NIH-NSF Visualization Research Challenges Report,, 2010.
[2] D. Koller, M. Turitzin, M. Levoy, M. Tarini, G. Croccia, P. Cignoni, and R. Scopigno, "Protected Interactive 3D Graphics via Remote Rendering," Proc. ACM SIGGRAPH, pp. 695-703, 2004.
[3] S.P. Callahan, J.L.D. Comba, P. Shirley, and C.T. Silva, "Interactive Rendering of Large Unstructured Grids Using Dynamic Level-of-Detail," Proc. IEEE Visualization Conf. '05, pp. 199-206, 2005.
[4] D. Luebke et al., Level of Detail for 3D Graphics. Morgan-Kaufmann Publishers, 2002.
[5] S.P. Callahan, L. Bavoil, V. Pascucci, and C.T. Silva, "Progressive Volume Rendering of Large Unstructured Grids," IEEE Trans. Visualization and Computer Graphics, vol. 12, no. 5, pp. 1307-1314, Sept./Oct. 2006.
[6] H. Hoppe, "Progressive Meshes," Proc. ACM SIGGRAPH, pp. 99-108, 1996.
[7] Y. Livnat, S.G. Parker, and C.R. Johnson, "Fast Isosurface Extraction Methods for Large Image Data Sets," Handbook of Medical Imaging, pp. 731-745, Academic Press, 2000.
[8] A. Gyulassy, V. Natarajan, V. Pascucci, P.-T. Bremer, and B. Hamann, "Topology-Based Simplification for Feature Extraction from 3D Scalar Fields," Proc. IEEE Visualization Conf. '05, pp. 272-280, 2005.
[9] S. Pesco, P. Lindstrom, V. Pascucci, and C. Silva, "Implicit Occluders," Proc. IEEE/ACM SIGGRAPH Symp. Volume Visualization, pp. 47-54, 2004.
[10] J. Gao and H.-W. Shen, "Parallel View-Dependent Isosurface Extraction Using Multi-Pass Occlusion Culling," Proc. IEEE Symp. Parallel and Large Data Visualization and Graphics, pp. 67-74, 2001.
[11] L. Lippert, M.H. Gross, and C. Kurmann, "Compression Domain Volume Rendering for Distributed Environments," Computer Graphics Forum, vol. 16, no. 3, pp. C95-C107, 1997.
[12] M. Isenburg, P. Lindstrom, and J. Snoeyink, "Streaming Compression of Triangle Meshes," Proc. Symp. Geometry Processing, pp. 111-118, 2005.
[13] X Protocol Reference Manual, A. Nye, ed., fourth ed. O'Reilly & Assoc., Jan. 1995.
[14] T. Richardson, Q. Stafford-Fraser, K.R. Wood, and A. Hopper, "Virtual Network Computing," IEEE Internet Computing, vol. 2, no. 1, pp. 33-38, Jan./Feb. 1998.
[15] G. Klimeck, M. McLennan, S.P. Brophy, G.B. Adams,III, and M.S. Lundstrom, " Advancing Education and Research in Nanotech," Computing in Science and Eng., vol. 10, no. 5, pp. 17-23, 2008.
[16] S. Stegmaier, M. Magallón, and T. Ertl, "A Generic Solution for Hardware-Accelerated Remote Visualization," Proc. EG/IEEE TCVG Symp. Data Visualization '02, pp. 87-94, 2002.
[17] Silicon Graphics, Inc., OpenGL Vizserver 3.0—Application-Transparent Remote Interactive Vis. and Collaboration, 2003.
[18] F. Lamberti and A. Sanna, "A Streaming-Based Solution for Remote Vis. of 3D Graphics on Mobile Devices," IEEE Trans. Visualization and Computer Graphics, vol. 13, no. 2, pp. 247-260, Mar./Apr. 2007.
[19] K.-L. Ma and D.M. Camp, "High Performance Visualization of Time-Varying Volume Data over a Wide-Area Network," Proc. IEEE Supercomputing Conf. (SC '00), 2000.
[20] S. Stegmaier, J. Diepstraten, M. Weiler, and T. Ertl, "Widening the Remote Visualization Bottleneck," Proc. IEEE Image and Signal Processing and Analysis (ISPA), pp. 1-6, 2003.
[21] E.J. Luke and C.D. Hansen, "Semotus Visum: A Flexible Remote Visualization Network," Proc. IEEE Visualization Conf. '02, pp. 61-68, 2002.
[22] W. Bethel, B. Tierney, J. Lee, D. Gunter, and S. Lau, "Using High-Speed WANs and Network Data Caches to Enable Remote and Distributed Visualization," Proc. IEEE Supercomputing Conf. (SC), 2000.
[23] G.W. Furnas, "Generalized Fisheye Views," Proc. ACM Conf. Human Factors in Computer Systems (CHI '86), pp. 16-23, 1986.
[24] J. Lamping and R. Rao, "The Hyperbolic Browser: A Focus + Context Technique for Visualizing Large Hierarchies," J. Visual Languages and Computing, vol. 7, no. 1, pp. 33-35, 1996.
[25] N. Wong, M.S.T. Carpendale, and S. Greenberg, "EdgeLens: An Interactive Method for Managing Edge Congestion in Graphs," Proc. IEEE Symp. Information Visualization '03, pp. 51-58, 2003.
[26] E. Pietriga and C. Appert, "Sigma Lenses: Focus-Context Transitions Combining Space, Time, and Translucence," Proc. 26th Conf. Human Factors in Computer Systems (CHI '08), pp. 1343-1352, 2008.
[27] N. Elmqvist, N. Henry, Y. Riche, and J.-D. Fekete, "Mélange: Space Folding for Multi-Focus Interaction," Proc. Conf. Human Factors in Computer Systems (CHI '08), 1333-1342, 20083.
[28] P. Baudisch, N. Good, and P. Stewart, "Focus Plus Context Screens: Combining Display Technology with Visualization Techniques," Proc. Symp. User Interface Software and Technology (UIST '01), pp. 31-40, 2001.
[29] M.S.T. Carpendale, D.J. Cowperthwaite, and D.F. Fracchia, "Distortion Viewing Techniques for 3-Dimensional Data," Proc. IEEE Symp. Information Visualization '96, pp. 46-53, 1996.
[30] N. Elmqvist, "BalloonProbe: Reducing Occlusion in 3D Using Interactive Space Distortion," Proc. ACM Symp. Virtual Reality Software and Technology '05, pp. 134-137, 2005.
[31] L. Wang, Y. Zhao, K. Mueller, and A. Kaufman, "The Magic Volume Lens: An Interactive Focus+Context Technique for Volume Rendering," Proc. IEEE Visualization Conf. '05, pp. 367-374, 2005.
[32] L. Williams, "Pyramidal Parametrics," Proc. ACM SIGGRAPH '83, vol. 17, no. 3, pp. 1-11, 1983.
[33] NVIDIA Corporation, http:/, 2010.
[34] ATI, AMD Corporation, index.html , 2010.
[35] A. Glassner, An Introduction to Ray Tracing. Academic Press, 1989.
[36] J.-D. Gascuel, N. Holzschuch, G. Fournier, and B. Péroche, "Fast Non-Linear Projections Using Graphics Hardware," Proc. ACM Symp. Interactive 3D Graphics, pp. 107-114, 2008.
[37] J. Yu and L. McMillan, "General Linear Cameras," Proc. European Conf. Computer Vision (ECCV '04), pp. 14-27, 2004.
[38] C. Mei, V. Popescu, and E. Sacks, "The Occlusion Camera," Proc. Eurographics '05, CG Forum, vol. 24, no. 3, 2005.
[39] L. McMillan and G. Bishop, "Plenoptic Modeling: An Image-Based Rendering System," Proc. ACM SIGGRAPH '95, pp. 39-46, 1995.
[40] G. Johnson, J. Lee, C.A. Burns, and W.R. Mark, "The Irregular Z-Buffer," ACM Trans. Graphics, vol. 24, no. 4, pp. 1462-1482, 2005.
[41] T. Aila and S. Laine, "Alias-Free Shadow Maps," Proc. Eurographics Symp. Rendering, pp. 161-166, 2004.
[42] L. Seiler et al., "Larrabee: A Many-Core x86 Architecture for Visual Computing," ACM Trans. Graphics, vol. 27, no. 3, pp. 1-15, 2008.
[43] D. Whalen and M.L. Norman, "Competition Data Set and Description," Proc. IEEE Visualization Design Contest, 2008.
[44] USGS, Crater Lake National Park Digital Elevation Model, , 2010.
[45] Univ. of Illinois at Urbana-Champaign, Visual Molecular Dynamics,, 2010.
[46] D. Laney, P.-T. Bremer, A. Mascarenhas, P. Miller, and V. Pascucci, "Understanding the Structure of the Turbulent Mixing Layer in Hydrodyn Instabilities," IEEE Trans. Visualization and Computer Graphics, vol. 12, no. 5, pp. 1053-1060, Sept./Oct. 2006.
[47] J. Yu, L. McMillan, and P. Sturm, "State of the Art Report: Multiperspective Rendering, Modeling, and Imaging," Proc. Eurographics, 2008.

Index Terms:
Nonuniform sampled images, interactive visualization, remote visualization, focus-plus-context, antialiasing.
Voicu Popescu, Paul Rosen, Laura Arns, Xavier Tricoche, Chris Wyman, Christoph M. Hoffmann, "The General Pinhole Camera: Effective and Efficient Nonuniform Sampling for Visualization," IEEE Transactions on Visualization and Computer Graphics, vol. 16, no. 5, pp. 777-790, Sept.-Oct. 2010, doi:10.1109/TVCG.2010.22
Usage of this product signifies your acceptance of the Terms of Use.