This Article 
 Bibliographic References 
 Add to: 
Registration Techniques for Using Imperfect and Par tially Calibrated Devices in Planar Multi-Projector Displays
November/December 2007 (vol. 13 no. 6)
pp. 1368-1375
Multi-projector displays today are automatically registered, both geometrically and photometrically, using cameras. Existing registration techniques assume pre-calibrated projectors and cameras that are devoid of imperfections such as lens distor tion. In practice, however, these devices are usually imperfect and uncalibrated. Registration of each of these devices is often more challenging than the multi-projector display registration itself. To make tiled projection-based displays accessible to a layman user we should allow the use of uncalibrated inexpensive devices that are prone to imperfections. In this paper, we make two impor tant advances in this direction. First, we present a new geometric registration technique that can achieve geometric alignment in the presence of severe projector lens distor tion using a relatively inexpensive low-resolution camera. This is achieved via a closed-form model that relates the projectors to cameras, in planar multi-projector displays, using rational Bezier patches. This enables us to geometrically calibrate a 3000 × 2500 resolution planar multi-projector display made of 3 × 3 array of nine severely distor ted projectors using a low resolution (640 × 480) VGA camera. Second, we present a photometric self-calibration technique for a projector-camera pair. This allows us to photometrically calibrate the same display made of nine projectors using a photometrically uncalibrated camera. To the best of our knowledge, this is the first work that allows geometrically imperfect projectors and photometrically uncalibrated cameras in calibrating multi-projector displays.

[1] Mitsubishi pocketprojector led dlp projector. Technical report, .
[2] E. S. Bhasker, P. Sinha, and A. Majumder, Asynchronous distributed calibration for scalable reconfigurable multi-projector displays. IEEE Transections of Visualization and Computer Graphics (TVCG), 12 (5): 1101–1108, 2006.
[3] J. Y. Bouguet, Camera calibration toolbox for matlab. Technical report, index.html.
[4] D. Brown, Decentering distortion of lenses. Photometric Engineering, 32 (3): 444–462, 1966.
[5] H. Chen, R. Sukthankar, G. Wallace, and K. Li, Scalable alignment of large-format multi-projector displays using camera homography trees. Proceedings of IEEE Visualization, 2002.
[6] Y. Chen, D. W. Clark, A. Finkelstein, T. Housel, and K. Li, Automatic alignment of high-resolution multi-projector displays using an uncalibrated camera. Proceedings of IEEE Visualization, 2000.
[7] K. Cornelis, M. Pollefeys, and L. V. Gool, Lens distortion recovery for accurate sequential structure and motion recovery. European Conference in Computer Vision, pages 186–200, 2002.
[8] P. E. Debevec and J. Malik, Recovering high dynamic range radiance maps from photographs. Proceedings of ACM Siggraph, pages 369–378, 1997.
[9] T. Disz, M. Papka, and R. Stevens, Ubiworld: An environment integrating virtual reality. Heterogeneous Computing Workshop, Geneva, Switzerland, 1997.
[10] J. Fryer and D. Brown, Lens distortion for close-range photogrammetry. Photogrammetric Engineering and Remote Sensing, 52 (1): 51–58, 1986.
[11] R. C. Gonzalez and R. E. Woods, Digital Image Processing. Addison Wesley, 1992.
[12] M. Hereld, I. Judson, and R. Stevens, Introduction to building projection-based tiled display systems. IEEE Computer Graphics and Applications, 2000.
[13] M. Hereld, I. R. Judson, and R. Stevens, Dottytoto: A measurement engine for aligning multi-projector display systems. Argonne National Laboratory preprint ANL/MCS-P958-0502, 2002.
[14] G. Humphreys, M. Houston, R. Ng, R. Frank, S. Ahem, P. Kirchner, and J. Klosowski, Chromium : A stream processing framework for interactive rendering on clusters. ACM Transactions of Graphics, 2002.
[15] H. G. Jung, Y. H. Lee, P. J. Yoon, and J. Kim, Radial distortion refinement by inverse mapping-based extrapolation. Proceedings to 18th International Conference on Pattern Recognition(ICPR), 2006.
[16] J. Lai, A. Levas, P. Chou, C. Pinhanez, and M. Viveros, Bluespace: Personalizing workspace through awareness and adaptability. International Journal of Human Computer Studies, 57 (5): 415–428, 2002.
[17] K. Li, H. Chen, Y. Chen, D. W. Clark, P. Cook, S. Damianakis, G. Essl, A. Finkelstein, T. Funkhouser, A. Klein, Z. Liu, E. Praun, R. Samanta, B. Shedd, J. P. Singh, G. Tzanetakis, and J. Zheng, Early experiences and challenges in building and using a scalable display wall system. IEEE Computer Graphics and Applications, 20 (4): 671–680, 2000.
[18] A. Majumder and M. Gopi, Modeling color properties of tiled displays. Computer Graphics Forum, June 2005.
[19] A. Majumder, Z. He, H. Towles, and G. Welch, Achieving color uniformity across multi-projector displays. Proceedings of IEEE Visualization, 2000.
[20] A. Majumder and R. Stevens, Color nonuniformity in projection-based displays: Analysis and solutions. IEEE Transactions on Visualization and Computer Graphics, 10 (2), March–April 2003.
[21] A. Majumder and R. Stevens, Perceptual photometric seamlessness in tiled projection-based displays. ACM Transactions on Graphics, 24 (1), January 2005.
[22] T. Mitsunaga and S. Nayar, Radiometric self calibration. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 1999.
[23] S. K. Nayar, H. Peri, M. D. Grossberg, and P. N. Belhumeur, A projection system with radiometric compensation for screen imperfections. Proceedings of IEEE International Workshop on Projector-Camera Systems, 2003.
[24] C. Pinhanez, The everywhere displays projector: A device to create ubiquitous graphical interfaces. Proceedings of Ubiquitous Computing, Atlanta, Georgia, 2001.
[25] C. S. Pinhanez, F. C. Kjeldsen, A. Levas, G. S. Pingali, M. E. Podlaseck, and P. B. Chou, Ubiquitous interactive graphics. Technical Report RC22495 (W0205-143), IBM Research, 2002.
[26] A. Raij, G. Gill, A. Majumder, H. Towles, and H. Fuchs, PixelFlex2: A Comprehensive, Automatic, Casually-Aligned Multi-Projector Display. IEEE International Workshop on Projector-Camera Systems, 2003.
[27] R. Raskar, Immersive planar displays using roughly aligned projectors. In Proceedings of IEEE Virtual Reality 2000, 1999.
[28] R. Raskar, M. Brown, R. Yang, W. Chen, H. Towles, B. Seales, and H. Fuchs, Multi projector displays using camera based registration. Proceedings of IEEE Visualization, 1999.
[29] R. Raskar, J. van Baar, P. Beardsley, T. Willwacher, S. Rao, and C. Forlines, ilamps: Geometrically aware and self-configuring projectors. ACM Transactions on Graphics, 22 (3), 2003.
[30] R. Raskar, G. Welch, M. Cutts, A. Lake, L. Stesin, and H. Fuchs, The office of the future: A unified approach to image based modeling and spatially immersive display. In Proceedings of ACM Siggraph, pages 168–176, 1998.
[31] S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach. Prentice-Hall, 1995.
[32] J. Salvi, X. Armangu, and J. Batlle, A comparative review of camera calibrating methods with accuracy evaluation. Pattern Recognition, 35: 1617–1635, 2002.
[33] P. Steurer and M. B. Srivastava, System design of smart table. Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003.
[34] R. Sukthankar, R. Stockton, and M. Mullin, Smarter presentations: Exploiting homography in cameraprojector systems. Proceedings of International Conference on Computer Vision (ICCV), 2001.
[35] R. Swaminathan and S. K. Nayar, Nonmetric calibration of wide-angle lenses and polycameras. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22 (10): 1172–1178, 2000.
[36] J. Underkoffler, B. Ullmer, and H. Ishii, Emancipated pixels: Real-world graphics in the luminous room. Proceedings of ACM Siggraph, 1999.
[37] R. Yang, D. Gotz, J. Hensley, H. Towles, and M. S. Brown, Pixelflex: A reconfigurable multi-projector display system. Proceedings of IEEE Visualization, 2001.
[38] R. Yang, A. Majumder, and M. Brown, Camera based calibration techniques for seamless multi-projector displays. IEEE Transactions on Visualization and Computer Graphics, 11 (2), March–April 2005.
[39] Z. Zhang, Flexible camera calibration by viewing a plane from unknown orientation. IEEE International Conference on Computer Vision, pages 666–673, 1999.

Index Terms:
Geometric calibration, photometric calibration, tiled displays
Ezekiel Bhasker, Ray Juang, Aditi Majumder, "Registration Techniques for Using Imperfect and Par tially Calibrated Devices in Planar Multi-Projector Displays," IEEE Transactions on Visualization and Computer Graphics, vol. 13, no. 6, pp. 1368-1375, Nov.-Dec. 2007, doi:10.1109/TVCG.2007.70586
Usage of this product signifies your acceptance of the Terms of Use.