This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Real-Time Adaptive Radiometric Compensation
January/February 2008 (vol. 14 no. 1)
pp. 97-108
Recent radiometric compensation techniques make it possible to project images onto colored and textured surfaces. This is realized with projector-camera systems by scanning the projection surface on a per-pixel basis. Using the captured information, a compensation image is calculated that neutralizes geometric distortions and color blending caused by the underlying surface. As a result, the brightness and the contrast of the input image is reduced compared to a conventional projection onto a white canvas. If the input image is not manipulated in its intensities, the compensation image can contain values that are outside the dynamic range of the projector. These will lead to clipping errors and to visible artifacts on the surface. In this article, we present an innovative algorithm that dynamically adjusts the content of the input images before radiometric compensation is carried out. This reduces the perceived visual artifacts while simultaneously preserving a maximum of luminance and contrast. The algorithm is implemented entirely on the GPU and is the first of its kind to run in real-time.

[1] M. Ashdown, T. Okabe, I. Sato, and Y. Sato, “Robust Content-Dependent Photometric Projector Compensation,” Proc. IEEE Int'l Workshop Projector-Camera Systems, pp. 60-68, 2006.
[2] O. Bimber, F. Coriand, A. Kleppe, E. Bruns, S. Zollmann, and T. Langlotz, “Superimposing Pictorial Artwork with Projected Imagery,” IEEE MultiMedia, vol. 12, pp. 16-26, 2005.
[3] O. Bimber, G. Wetzstein, A. Emmerling, and C. Nitschke, “Enabling View-Dependent Stereoscopic Projection in Real Environments,” Proc. Int'l Symp. Mixed and Augmented Reality (ISMAR '05), pp. 14-23, 2005.
[4] O. Bimber, A. Emmerling, and T. Klemmer, “Embedded Entertainment with Smart Projectors,” Computer, vol. 38, pp. 56-63, 2005.
[5] N. Boukala, P. Colatini, and J.D. Runga, “Fast and Accurate Color Image Processing Using 3D Graphics Cards,” Proc. Eighth Int'l Fall Workshop: Vision Modeling and Visualization, 2003.
[6] R. Dumont, F. Pellacini, and J.A. Ferwerda, “A Perceptually-Based Texture Caching Algorithm for Hardware-Based Rendering,” Proc. 12th Eurographics Workshop Rendering Techniques, pp. 249-256, 2001.
[7] F. Durand and J. Dorsey, “Interactive Tone Mapping,” Proc. Eurographics Workshop Rendering Techniques, pp. 219-230, 2000.
[8] J.D. Foley, A. van Dam, S.K. Feiner, and J.F. Hughes, Computer Graphics: Principles and Practice, second ed. Addison-Wesley, 1990.
[9] K. Fujii, M.D. Grossberg, and S.K. Nayar, “A Projector-Camera System with Real-Time Photometric Adaptation for Dynamic Environments,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition (CVPR '05), vol. 1, pp. 814-821, 2005.
[10] E.B. Goldstein, Sensation and Perception. Wadsworth Publishing, 2001.
[11] N. Goodnight, R. Wang, C. Woolley, and G. Humphreys, “Interactive Time-Dependent Tone Mapping Using Programmable Graphics Hardware,” Proc. 14th Eurographics Workshop Rendering, pp. 26-37, 2003.
[12] M.D. Grossberg, P. Harish, and S.K. Nayar, “Making One Object Look Like Another: Controlling Appearance Using a Projector-Camera System,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 452-459, 2004.
[13] K. Grzegorz, K. Myszkowski, and H.-P. Seidel, “Perceptual Effects in Real-Time Tone Mapping,” Proc. 21st Spring Conf. Computer Graphics, pp. 195-202, 2005.
[14] G.W. Larson, H. Rushmeier, and C. Piatko, “A Visibility Matching Tone Reproduction Operator for High Dynamic Range Scenes,” IEEE Trans. Visualization and Computer Graphics, vol. 3, no. 4, pp.291-306, Oct.-Dec. 1997.
[15] C.J. Lloyd, “Quantifying Edge Blend Quality: Correlation with Observed Judgements,” Proc. Image Conf., 2002.
[16] J. Lubin, “A Visual Discrimination Model for Imaging System Design and Evaluation,” Vision Models for Target Detection and Recognition, pp. 245-283, World Scientific, 1995.
[17] A. Majumder, “A Practical Framework to Achieve Perceptually Seamless Multi-Projector Displays,” PhD dissertation, Dept. of Computer Science, Univ. of North Carolina-Chapel Hill, 2003.
[18] S.K. Nayar, H. Peri, M.D. Grossberg, and P.N. Belhumeur, “A Projection System with Radiometric Compensation for Screen Imperfections,” Proc. IEEE Int'l Workshop Projector-Camera Systems, 2003.
[19] H. Park, M.-H. Lee, and S.-J. Kim, “Contrast Enhancement in Direct-Projected Augmented Reality,” Proc. Int'l Conf. Multimedia and Expo (ICME '06), 2006.
[20] M. Ramasubramanian, S. Pattanaik, and D.P. Greenberg, “A Perceptually Based Physical Error Metric for Realistic Image Synthesis,” Proc. ACM SIGGRAPH '99, pp. 73-82, 1999.
[21] D. Wang, I. Sato, O. Takahiro, and Y. Sato, “Radiometric Compensation in a Projector-Camera System Based Properties of Human Vision System,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition (CVPR '05)—Workshops, vol. 03, p. 100, 2005.
[22] G. Wetzstein and O. Bimber, “Radiometric Compensation of Global Illumination Effects with Projector-Camera Systems,” Proc. ACM SIGGRAPH '06, poster, 2006.
[23] A. Raij, G. Gill, A. Majumder, H. Towles, and H. Fuchs, “PixelFlex2: A Comprehensive, Automatic, Casually-Aligned Multi-Projector Display,” Proc. IEEE Int'l Workshop Projector-Camera Systems, 2003.
[24] A. Majumder and R. Stevens, “Perceptual Photometric Seamlessness in Projection-Based Tiled Displays,” ACM Trans. Graphics, vol. 24, no. 1, 2005.

Index Terms:
Computer graphics, picture/image generation, display algorithms, image processing, computer vision, radiometry, reflectance, enhancement, color
Citation:
Anselm Grundh?fer, Oliver Bimber, "Real-Time Adaptive Radiometric Compensation," IEEE Transactions on Visualization and Computer Graphics, vol. 14, no. 1, pp. 97-108, Jan.-Feb. 2008, doi:10.1109/TVCG.2007.1052
Usage of this product signifies your acceptance of the Terms of Use.