The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.03 - March (2013 vol.19)
pp: 407-419
P. Harish , Center for Visual Inf. Technol., Int. Inst. of Inf. Technol., Hyderabad, India
P. J. Narayanan , Center for Visual Inf. Technol., Int. Inst. of Inf. Technol., Hyderabad, India
ABSTRACT
Displays remain flat and passive amidst the many changes in their fundamental technologies. One natural step ahead is to create displays that merge seamlessly in shape and appearance with one's natural surroundings. In this paper, we present a system to design, render to, and build view-dependent multiplanar displays of arbitrary piecewise-planar shapes, built using polygonal facets. Our system provides high quality, interactive rendering of 3D environments to a head-tracked viewer on arbitrary multiplanar displays. We develop a novel rendering scheme that produces exact image and depth map at each facet, producing artifact-free images on and across facet boundaries. The system scales to a large number of display facets by rendering all facets in a single pass of rasterization. This is achieved using a parallel, perframe, view-dependent binning and prewarping of scene triangles. The display is driven using one or more target quilt images into which facet pixels are packed. Our method places no constraints on the scene or the display and allows for fully dynamic scenes to be rendered interactively at high resolutions. The steps of our system are implemented efficiently on commodity GPUs. We present a few prototype displays to establish the scalability of our system on different display shapes, form factors, and complexity: from a cube made out of LCD panels to spherical/cylindrical projected setups to arbitrary complex shapes in simulation. Performance of our system is demonstrated for both rendering quality and speed, for increasing scene and display facet sizes. A subjective user study is also presented to evaluate the user experience using a walk-around display compared to a flat panel for a game-like setting.
INDEX TERMS
Rendering (computer graphics), Three dimensional displays, Shape, Cameras, Pipelines, Head,user interaction, Nonrectangular displays, fish tank virtual reality, arbitrary shaped displays, 3D visualization, view-dependent rendering, parallel culling
CITATION
P. Harish, P. J. Narayanan, "Designing Perspectively Correct Multiplanar Displays", IEEE Transactions on Visualization & Computer Graphics, vol.19, no. 3, pp. 407-419, March 2013, doi:10.1109/TVCG.2012.135
REFERENCES
[1] R.A. Newcombe, S. Izadi, O. Hilliges, D. Molyneaux, D. Kim, A.J. Davison, P. Kohli, J. Shotton, S. Hodges, and A. Fitzgibbon, "Kinectfusion: Real-Time Dense Surface Mapping and Tracking," Proc. IEEE 10th Int'l Symp. Mixed and Augmented Reality (ISMAR '11), pp. 127-136, 2011.
[2] O. Bimber, G. Wetzstein, A. Emmerling, and C. Nitschke, "Enabling View-Dependent Stereoscopic Projection in Real Environments," Proc. IEEE/ACM Fourth Int'l Symp. Mixed and Augmented Reality, pp. 14-23, 2005.
[3] K. Akeley and J. Su, "Minimum Triangle Separation for Correct Zbuffer Occlusion," Proc. 21st ACM SIGGRAPH/EUROGRAPHICS Symp. Graphics Hardware (GH '06), pp. 27-30, 2006.
[4] A.J. Sabri, R.G. Ball, A. Fabian, S. Bhatia, and C. North, "High Resolution Gaming: Interfaces, Notifications, and the User Experience," Interacting with Computers, vol. 19, pp. 151-166, Mar. 2007.
[5] Nirnimesh, P. Harish, and P.J. Narayanan, "Garuda: A Scalable Tiled Display Wall Using Commodity Pcs," IEEE Trans. Visualization and Computer Graphics, vol. 13, no. 5, pp. 864-877, Sept./Oct. 2007.
[6] L. Shupp, R. Ball, B. Yost, J. Booker, and C. North, "Evaluation of Viewport Size and Curvature of Large, High-Resolution Displays," Proc. Graphics Interface, pp. 123-130, 2006.
[7] U. Hahne, J. Schild, S. Elstner, and M. Alexa, "Multi-Touch Focus+Context Sketch-Based Interaction," Proc. Sixth Eurographics Symp. Sketch-Based Interfaces and Modeling (SBIM '09), pp. 77-83, 2009.
[8] P. Baudisch, N. Good, and P. Stewart, "Focus Plus Context Screens: Combining Display Technology with Visualization Techniques," Proc. 14th Ann. ACM Symp. User Interface Software and Technology (UIST '01), pp. 31-40, 2001.
[9] R. Raskar, G. Welch, and H. Fuchs, "Seamless Projection Overlaps Using Image Warping and Intensity Blending," Proc. Fourth Int'l Conf. Virtual Systems and Multimedia, 1998.
[10] P. Bourke, "Idome: Immersive Gaming with the Unity Game Engine," Proc. Computer Games and Allied Technology (CGAT '09), pp. 265-272, 2009.
[11] R. Raskar, G. Welch, K.-L. Low, and D. Bandyopadhyay, "Shader lamps: Animating Real Objects with Image-Based Illumination," Proc. 12th Eurographics Workshop Rendering Techniques, pp. 89-102, 2001.
[12] A. Law, D. Aliaga, B. Sajadi, A. Majumder, and Z. Pizlo, "Perceptually-Based Appearance Modification for Compliant Appearance Editing," Computer Graphics Forum, vol. 30, pp. 2288-2300, 2011.
[13] B. Sajadi and A. Majumder, "Autocalibration of Multiprojector Cavelike Immersive Environments," IEEE Trans. Visualization and Computer Graphics, vol. 18, no. 3, pp. 381-393, Mar. 2012.
[14] S. Kettner, C. Madden, and R. Ziegler, "Direct Rotational Interaction with a Spherical Projection," Proc. Interaction: Systems, Practice and Theory, 2004.
[15] S. Schkolne, M. Pruett, and P. Schröder, "Surface Drawing: Creating Organic 3D Shapes with the Hand and Tangible Tools," Proc. SIGCHI Conf. Human Factors in Computing Systems, pp. 261-268, 2001.
[16] Microsoft, Microsoft Surface 2.0, http://www.microsoft.com surface/, 2007.
[17] H. Benko, A.D. Wilson, and R. Balakrishnan, "Sphere: Multi-Touch Interactions on a Spherical Display," Proc. 21st Ann. ACM Symp. User Interface Software and Technology (UIST '08), pp. 77-86, 2008.
[18] S.S. Fisher, "Viewpoint Dependent Imaging: An Interactive Stereoscopic Display," Proc. SPIE, vol. 367, pp. 41-45, 1982.
[19] C. Cruz-Neira, D.J. Sandin, and T.A. DeFanti, "Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the Cave," Proc. SIGGRAPH '93, pp. 135-142, 1993.
[20] J. Djajadiningrat, C. Overbeeke, and P. Stappers, "Cubby: A Unified Interaction Space for Precision Manipulation," Proc. IEEE Transportation Electrification Conf. and Expo (ITEC), pp. 24-26, 2001.
[21] J.W. Frens, J.P. Djajadiningrat, and C.J. Overbeeke, "Cubby+: Exploring Interaction," Proc. Designing Interactive Systems (DIS' 02), pp. 135-140, 2002.
[22] I. Stavness, F. Vogt, and S. Fels, "Cubee: A Cubic 3D Display for Physics-Based Interaction," Proc. SIGGRAPH '06, p. 165. 2006,
[23] I. Stavness, B. Lam, and S. Fels, "Pcubee: A Perspective-Corrected Handheld Cubic Display," Proc. Conf. Human Factors in Computing Systems, pp. 1381-1390, 2010.
[24] H. Iwata, "Full-Surround Image Display Technologies," Int'l J. Computer Vision, vol. 58, pp. 227-235, 2004.
[25] M. Deering, "High Resolution Virtual Reality," SIGGRAPH Computer Graphics, vol. 26, no. 2, pp. 195-202, 1992.
[26] X. Hou, L.-Y. Wei, H.-Y. Shum, and B. Guo, "Real-Time Multiperspective Rendering on Graphics Hardware," Proc. EUROGRAPHICS Symp. Rendering, pp. 93-102, 2006.
[27] M. Ashdown, M. Flagg, R. Sukthankar, and J.M. Rehg, "A Flexible Projector-Camera System for Multi-Planar Displays," Proc. IEEE CS Conf. Computer Vision and Pattern Recognitation (CVPR), pp. 165-172, 2004.
[28] R. Raskar, "Immersive Planar Display Using Roughly Aligned Projectors," Proc. IEEE Virtual Reality (VR '00), 2000.
[29] P. Harish and P.J. Narayanan, "A View-Dependent, Polyhedral 3D Display," Proc. Eight Int'l Conf. Virtual Reality Continuum and Its Applications in Industry (VRCAI), pp. 71-75, 2009.
[30] R.I. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, second ed. Cambridge Univ. Press, 2004.
[31] Nvidia, CUDA Programming Guide for CUDA Toolkit 3.2, 2011.
[32] T. Möller, "A Fast Triangle-Triangle Intersection Test," J. Graphics, GPU, and Game Tools, vol. 2, no. 2, pp. 25-30, 1997.
[33] S. Patidar and P.J. Narayanan, "Scalable Split and Gather Primitives for the GPU," technical report IIIT/TR/2009/99, 2009.
[34] S. Liao, M.A. Lopez, and D. Mehta, "Constrained Polygon Transformations for Incremental Floorplanning," ACM Trans. Design Automation of Electronic Systems, vol. 6, pp. 322-342, 2001.
[35] NaturalPoint, TrackIR5, www.naturalpoint.com/trackir/ productstrackir5 /, 2009.
[36] ARToolkit, www.hitl.washington.eduartoolkit/, 2002.
[37] A. Majumder, "Contrast Enhancement of Multi-Displays Using Human Contrast Sensitivity," Proc. Computer Vision and Pattern Recognition, pp. 377-382, 2005.
61 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool