The Community for Technology Leaders
RSS Icon
Issue No.09 - September (2011 vol.17)
pp: 1209-1222
Behzad Sajadi , University of California, Irvine, Irvine
In this paper, we present a novel technique to calibrate multiple casually aligned projectors on fiducial-free piecewise smooth vertically extruded surfaces using a single camera. Such surfaces include cylindrical displays and CAVEs, common in immersive virtual reality systems. We impose two priors to the display surface. We assume the surface is a piecewise smooth vertically extruded surface for which the aspect ratio of the rectangle formed by the four corners of the surface is known and the boundary is visible and segmentable. Using these priors, we can estimate the display's 3D geometry and camera extrinsic parameters using a nonlinear optimization technique from a single image without any explicit display to camera correspondences. Using the estimated camera and display properties, the intrinsic and extrinsic parameters of each projector are recovered using a single projected pattern seen by the camera. This in turn is used to register the images on the display from any arbitrary viewpoint making it appropriate for virtual reality systems. The fast convergence and robustness of this method is achieved via a novel dimension reduction technique for camera parameter estimation and a novel deterministic technique for projector property estimation. This simplicity, efficiency, and robustness of our method enable several coveted features for nonplanar projection-based displays. First, it allows fast recalibration in the face of projector, display or camera movements and even change in display shape. Second, this opens up, for the first time, the possibility of allowing multiple projectors to overlap on the corners of the CAVE—a popular immersive VR display system. Finally, this opens up the possibility of easily deploying multiprojector displays on aesthetic novel shapes for edutainment and digital signage applications.
Tiled displays, autocalibration, geometric registration, cylindrical displays, CAVES.
Behzad Sajadi, "Autocalibrating Tiled Projectors on Piecewise Smooth Vertically Extruded Surfaces", IEEE Transactions on Visualization & Computer Graphics, vol.17, no. 9, pp. 1209-1222, September 2011, doi:10.1109/TVCG.2011.33
[1] R. Raskar, M.S. Brown, R. Yang, W.-C. Chen, G. Welch, H. Towles, B. Seales, and H. Fuchs, "Multi-Projector Displays Using Camera-Based Registration," Proc. Conf. Visualization, pp. 161-522, 1999.
[2] D. Cotting, M. Naef, M. Gross, and H. Fuchs, "Embedding Imperceptible Patterns into Projected Images for Simultaneous Acquisition and Display," Proc. Int'l Symp. Mixed and Augmented Reality, pp. 100-109, 2004.
[3] D. Cotting, R. Ziegler, M. Gross, and H. Fuchs, "Adaptive Instant Displays: Continuously Calibrated Projections Using Per-Pixel Light Control," Proc. Eurographics, pp. 705-714, 2005.
[4] T. Johnson and H. Fuchs, "Real-Time Projector Tracking on Complex Geometry Using Ordinary Imagery," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '07), pp. 1-8, 2007.
[5] J. Zhou, L. Wang, A. Akbarzadeh, and R. Yang, "Multi-Projector Display with Continuous Self-Calibration," Proc. Fifth ACM/IEEE Int'l Workshop Projector-Camera Systems, pp. 3:1-3:7, 2008.
[6] T. Johnson, G. Welch, H. Fuchs, E. la Force, and H. Towles, "A Distributed Cooperative Framework for Continuous Multi-Projector Pose Estimation," Proc. IEEE Virtual Reality Conf. (VR '09), pp. 35-42, 2009.
[7] M. Harville, B. Culbertson, I. Sobel, D. Gelb, A. Fitzhugh, and D. Tanguay, "Practical Methods for Geometric and Photometric Correction of Tiled Projector," Proc. Conf. Computer Vision and Pattern Recognition Workshop (CVPRW '06), p. 5, 2006.
[8] W. Sun, I. Sobel, B. Culbertson, D. Gelb, and I. Robinson, "Calibrating Multi-Projector Cylindrically Curved Displays for "Wallpaper" Projection," Proc. Fifth ACM/IEEE Int'l Workshop Projector-Camera Systems (PROCAMS) pp. 1:1-1:8, 2008.
[9] M.S. Brown and W.B. Seales, "A Practical and Flexible Tiled Display System," Proc. 10th Pacific Conf. Computer Graphics and Applications, pp. 194-203, 2002.
[10] B. Sajadi and A. Majumder, "Markerless View-Independent Registration of Multiple Distorted Projectors on Extruded Surfaces Using an Uncalibrated Camera," IEEE Trans. Visualization and Computer Graphics (Visualization), vol. 15, no. 6, pp. 1307-1316, Nov./Dec. 2009.
[11] A. Raij and M. Pollefeys, "Auto-Calibration of Multi-Projector Display Walls," Proc. 17th Int'l Conf. Pattern Recognition (ICPR '04), pp. 14-17, 2004.
[12] R. Raskar, J. van Baar, P. Beardsley, T. Willwacher, S. Rao, and C. Forlines, "Ilamps: Geometrically Aware and Self-Configuring Projectors," ACM Trans. Graphics, vol. 22, no. 3, pp. 809-818, 2003.
[13] A. Raij, G. Gill, A. Majumder, H. Towles, and H. Fuchs, "Pixelflex 2: A Comprehensive Automatic Casually Aligned Multi-Projector Display," Proc. IEEE Int'l Workshop Projector-Camera Systems (PROCAMS), 2003.
[14] R. Yang, D. Gotz, J. Hensley, H. Towles, and M.S. Brown, "Pixelflex: A Reconfigurable Multi-Projector Display System," Proc. Visualization, pp. 167-174, 2001.
[15] E. Bhasker, R. Juang, and A. Majumder, "Registration Techniques for Using Imperfect and Partially Calibrated Devices in Planar Multi-Projector Displays," IEEE Trans. Visualization and Computer Graphics, vol. 13, no. 6, pp. 1368-1375, Nov./Dec. 2007.
[16] H. Chen, R. Sukthankar, G. Wallace, and K. Li, "Scalable Alignment of Large-Format Multi-Projector Displays Using Camera Homography Trees," Proc. IEEE Visualization (VIS '02), pp. 339-346, 2002.
[17] E.S. Bhasker, P. Sinha, and A. Majumder, "Asynchronous Distributed Calibration for Scalable and Reconfigurable Multi-Projector Displays," IEEE Trans. Visualization and Computer Graphics, vol. 12, no. 5, pp. 1101-1108, Sept. 2006.
[18] D.G. Aliaga and Y. Xu, "Photogeometric Structured Light: A Self-Calibrating and Multi-Viewpoint Framework for Accurate 3D Modeling," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '08), pp. 1-8, 2008.
[19] D.G. Aliaga, "Digital Inspection: An Interactive Stage for Viewing Surface Details," Proc. ACM Symp. Interactive 3D Graphics, pp. 53-60, 2008.
[20] R. Raskar, J.V. Baar, T. Willwacher, and S. Rao, "Quadric Transfer Function for Immersive Curved Screen Displays," Proc. Eurographics, 2004.
[21] R. Yang and G. Welch, "Automatic Projector Display Surface Estimation Using Every-Day Imagery," Proc. Ninth Int'l Conf. in Central Europe on Computer Graphics, Visualization and Computer Vision, 2001.
[22] S. Zollmann, T. Langlotz, and O. Bimber, "Passive-Active Geometric Calibration for View-Dependent Projections onto Arbitrary Surfaces," Proc. Workshop Virtual and Augmented Reality (AR/VR), 2006.
[23] M. Brown, A. Majumder, and R. Yang, "Camera-Based Calibration Techniques for Seamless Multiprojector Displays," IEEE Trans. Visualization and Computer Graphics, vol. 11, no. 2, pp. 193-206, Mar./Apr. 2005.
[24] B. Sajadi and A. Majumder, "Auto-Calibration of Cylindrical Multi-Projector Systems," Proc. IEEE Virtual Reality (VR) Conf., pp. 155-162, 2010.
[25] N. Snavely, S.M. Seitz, and R. Szeliski, "Photo Tourism: Exploring Photo Collections in Third," Proc. ACM SIGGRAPH, pp. 835-846, 2006.
[26] A. Majumder and R. Stevens, "Perceptual Photometric Seamlessness in Projection-Based Tiled Displays," ACM Trans. Graphics, vol. 24, pp. 118-139, Jan. 2005.
[27] A. Majumder and R. Stevens, "Color Nonuniformity in Projection-Based Displays: Analysis and Solutions," IEEE Trans. Visualization and Computer Graphics, vol. 10, no. 2, pp. 177-188, Mar./Apr. 2004.
[28] G. Ferrari-Trecate and M. Muselli, "A New Learning Method for Piecewise Linear Regression," Lecture Notes in Computer Science, J. D. Dorronsoro, eds., vol. 2415, pp. 444-449, 2002.
[29] M. Ashdown, M. Flagg, R. Sukthankar, and J.M. Rehg, "A Flexible Projector-Camera System for Multi-Planar Displays," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition (CVPR '04), pp. 165-172, 2003.
25 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool