This Article 
 Bibliographic References 
 Add to: 
Autocalibration of Multiprojector CAVE-Like Immersive Environments
March 2012 (vol. 18 no. 3)
pp. 381-393
Behzad Sajadi, University of California, Irvine, Irvine
Aditi Majumder, University of California, Irvine, Irvine
In this paper, we present the first method for the geometric autocalibration of multiple projectors on a set of CAVE-like immersive display surfaces including truncated domes and 4 or 5-wall CAVEs (three side walls, floor, and/or ceiling). All such surfaces can be categorized as swept surfaces and multiple projectors can be registered on them using a single uncalibrated camera without using any physical markers on the surface. Our method can also handle nonlinear distortion in the projectors, common in compact setups where a short throw lens is mounted on each projector. Further, when the whole swept surface is not visible from a single camera view, we can register the projectors using multiple pan and tilted views of the same camera. Thus, our method scales well with different size and resolution of the display. Since we recover the 3D shape of the display, we can achieve registration that is correct from any arbitrary viewpoint appropriate for head-tracked single-user virtual reality systems. We can also achieve wallpapered registration, more appropriate for multiuser collaborative explorations. Though much more immersive than common surfaces like planes and cylinders, general swept surfaces are used today only for niche display environments. Even the more popular 4 or 5-wall CAVE is treated as a piecewise planar surface for calibration purposes and hence projectors are not allowed to be overlapped across the corners. Our method opens up the possibility of using such swept surfaces to create more immersive VR systems without compromising the simplicity of having a completely automatic calibration technique. Such calibration allows completely arbitrary positioning of the projectors in a 5-wall CAVE, without respecting the corners.

[1] R. Raskar, M. Brown, R. Yang, W. Chen, H. Towles, B. Seales, and H. Fuchs, “Multi Projector Displays Using Camera Based Registration,” Proc. IEEE Visualization, 1999.
[2] D. Aliaga, “Digital Inspection: An Interactive Stage for Viewing Surface Details,” Proc. ACM Symp. Interactive 3D Graphics (I3D), 2008.
[3] D. Aliaga and Y. Xu, “Photogeometric Structured Light: A Self-Calibrating and Multi-Viewpoint Framework for Accurate 3D Modeling,” Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2008.
[4] R. Raskar, J.V. Baar, T. Willwacher, and S. Rao, “Quadric Transfer Function for Immersive Curved Screen Displays,” Proc. Eurographics Conf., 2004.
[5] T. Johnson, F. Gyarfas, R. Skarbez, H. Towles, and H. Fuchs, “A Personal Surround Environment: Projective Display with Correction for Display Surface Geometry and Extreme Lens Distortion,” Proc. IEEE Virtual Reality Conf., 2007.
[6] D. Cotting, M. Naes, M. Gross, and H. Fuchs, “Embedding Imperceptible Patterns into Projected Images for Simultaneous Acquisition and Display,” Proc. IEEE/ACM Int'l Symp. Mixed and Augmented Reality (ISMAR), 2004.
[7] M. Harville, B. Culbertson, I. Sobel, D. Gelb, A. Fitzhugh, and D. Tanguay, “Practical Methods for Geometric and Photometric Correction of Tiled Projector Displays on Curved Surfaces,” Proc. IEEE Int'l Workshop Projector Camera Systems (PROCAMS), 2006.
[8] W. Sun, I. Sobel, B. Culbertson, D. Gelb, and I. Robinson, “Calibrating Multi-Projector Cylindrically Curved Displays for ‘Wallpaper’ Projection,” Proc. IEEE/ACM Int'l Workshop Projector Camera Systems (PROCAMS), 2008.
[9] B. Sajadi and A. Majumder, “Markerless View-Independent Registration of Multiple Distorted Projectors on Vertically Extruded Surface Using a Single Uncalibrated Camera,” IEEE Trans. Visualization and Computer Graphics, vol. 15, no. 6, pp. 1307-1316, Nov./Dec. 2009.
[10] B. Sajadi and A. Majumder, “Auto-Calibration of Cylindrical Multi-Projector Systems,” Proc. IEEE Virtual Reality Conf., 2010.
[11] R. Raskar, “Immersive Planar Displays Using Roughly Aligned Projectors,” Proc. IEEE Virtual Reality Conf., 2000.
[12] H. Chen, R. Sukthankar, G. Wallace, and K. Li, “Scalable Alignment of Large-Format Multi-Projector Displays Using Camera Homography Trees,” Proc. IEEE Visualization, 2002.
[13] A. Raij and M. Polleyfeys, “Auto-Calibration of Multi-Projector Display Walls,” Proc. 17th Int'l Conf. Pattern Recognition (ICPR), 2004.
[14] R. Yang, D. Gotz, J. Hensley, H. Towles, and M.S. Brown, “Pixelflex: A Reconfigurable Multi-Projector Display System,” Proc. IEEE Visualization, 2001.
[15] R. Yang, A. Majumder, and M. Brown, “Camera based Calibration Techniques for Seamless Multi-Projector Displays,” IEEE Trans. Visualization and Computer Graphics, vol. 11, no. 2, pp. 193-206, Mar./Apr. 2005.
[16] A. Raij, G. Gill, A. Majumder, H. Towles, and H. Fuchs, “Pixelflex 2: A Comprehensive Automatic Casually Aligned Multi-Projector Display,” Proc. IEEE Int'l Workshop Projector Camera Systems (PROCAMS), 2003.
[17] M. Ashdown, M. Flagg, R. Sukthankar, and J.M. Rehg, “A Flexible Projector-Camera System for Multi-Planar Displays,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition (CVPR), 2004.
[18] E. Bhasker, R. Juang, and A. Majumder, “Registration Techniques for Using Imperfect and Partially Calibrated Devices in Planar Multi-Projector Displays,” IEEE Trans. Visualization and Computer Graphics, vol. 13, no. 6, pp. 1368-1375, Nov./Dec. 2007.
[19] B. Sajadi and A. Majumder, “Auto-Calibrating Projectors for Tiled Displays on Piecewise Smooth Vertically Extruded Surfaces,” IEEE Trans. Visualization and Computer Graphics, vol. 17, no. 9, pp. 1209-1222, Sept. 2011.
[20] N. Snavely, S.M. Seitz, and R. Szeliski, “Photo Tourism: Exploring Photo Collections in 3D,” Proc. ACM SIGGRAPH, 2006.
[21] R. Raskar, G. Welch, M. Cutts, A. Lake, L. Stesin, and H. Fuchs, “The Office of the Future: A Unified Approach to Image Based Modeling and Spatially Immersive Display,” Proc. ACM SIGGRAPH, 1998.
[22] B. Springborn, P. Schröder, and U. Pinkall, “Conformal Equivalence of Triangle Meshes,” ACM Trans. Graphics, vol. 27, no. 3, pp. 1-11, 2008.
[23] B. Sajadi and A. Majumder, “Scalable Multi-View Registration for Multi-Projector Displays on Vertically Extruded Surfaces,” Proc. EuroVision Conf., 2010.
[24] B. Sajadi, M. Lazarov, A. Majumder, and M. Gopi, “Color Seamlessness in Multi-Projector Displays Using Constrained Gamut Morphing,” IEEE Trans. Visualization and Computer Graphics, vol. 15, no. 6, pp. 1317-1326, Nov./Dec. 2009.
[25] G. Humphreys, M. Houston, R. Ng, R. Frank, S. Ahem, P. Kirchner, and J. Klosowski, “Chromium : A Stream Processing Framework for Interactive Rendering on Clusters,” Proc. ACM SIGGRAPH, 2002.
[26] Z. Zhang, “Flexible Camera Calibration by Viewing a Plane from Unknown Orientations,” Proc. IEEE Seventh Int'l Conf. Computer Vision (ICCV), 1999.

Index Terms:
Geometric registration, calibration, multiprojector displays, tiled displays, CAVEs, immersive displays.
Behzad Sajadi, Aditi Majumder, "Autocalibration of Multiprojector CAVE-Like Immersive Environments," IEEE Transactions on Visualization and Computer Graphics, vol. 18, no. 3, pp. 381-393, March 2012, doi:10.1109/TVCG.2011.271
Usage of this product signifies your acceptance of the Terms of Use.