The Community for Technology Leaders
RSS Icon
Issue No.02 - Feb. (2013 vol.19)
pp: 236-248
C. Menk , Volkswagen AG, Wolfsburg, Germany
R. Koch , Inst. fuer Inf., Albrechts-Univ. zu Kiel, Kiel, Germany
Spatial augmented reality is especially interesting for the design process of a car, because a lot of virtual content and corresponding real objects are used. One important issue in such a process is that the designer can trust the visualized colors on the real object, because design decisions are made on basis of the projection. In this paper, we present an interactive visualization technique which is able to exactly compute the RGB values for the projected image, so that the resulting colors on the real object are equally perceived as the real desired colors. Our approach computes the influences of the ambient light, the material, the pose and the color model of the projector to the resulting colors of the projected RGB values by using a physically based computation. This information allows us to compute the adjustment for the RGB values for varying projector positions at interactive rates. Since the amount of projectable colors does not only depend on the material and the ambient light, but also on the pose of the projector, our method can be used to interactively adjust the range of projectable colors by moving the projector to arbitrary positions around the real object. We further extend the mentioned method so that it is applicable to multiple projectors. All methods are evaluated in a number of experiments.
production engineering computing, augmented reality, automobile industry, data visualisation, design engineering, interactive systems, projector positions, truthful color reproduction, spatial augmented reality applications, car design process, virtual content, visualized colors, interactive visualization technique, RGB values, projected image, physically based computation, Image color analysis, Materials, Table lookup, Augmented reality, Visualization, Radiometry, Observers, color, Computer graphics, picture/image generation, display algorithms, raytracing, augmented reality, image processing and computer vision, radiometry
C. Menk, R. Koch, "Truthful Color Reproduction in Spatial Augmented Reality Applications", IEEE Transactions on Visualization & Computer Graphics, vol.19, no. 2, pp. 236-248, Feb. 2013, doi:10.1109/TVCG.2012.146
[1] D.G. Aliaga, A.J. Law, and Y.H. Yeung, "A Virtual Restoration Stage for Real-World Objects," Proc. ACM SIGGRAPH Asia papers, pp. 1-10, 2008.
[2] M. Ashdown, T. Okabe, I. Sato, and Y. Sato, "Robust Content-Dependent Photometric Projector Compensation," Proc. Conf. Computer Vision and Pattern Recognition Workshop (CVPRW '06), p. 6, 2006.
[3] O. Bimber, A. Emmerling, and T. Klemmer, "Embedded Entertainment with Smart Projectors," Computer, vol. 38, no. 1, pp. 48-55, 2005.
[4] O. Bimber, D. Iwai, G. Wetzstein, and A. Grundhöfer, "The Visual Computing of Projector-Camera Systems," Computer Graphic Forum, vol. 27, no. 8, pp. 2219-2245, 2008.
[5] K. Fujii, M.D. Grossberg, and S.K. Nayar, "A Projector-Camera System with Real-Time Photometric Adaptation for Dynamic Environments," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, p. 1180, 2005.
[6] M.D. Grossberg, H. Peri, S.K. Nayar, and P.N. Belhumeur, "Making One Object Look Like Another: Controlling Appearance Using a Projector-Camera System," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 452-459, 2004.
[7] A. Grundhofer and O. Bimber, "Real-Time Adaptive Radiometric Compensation," IEEE Trans. Visualization and Computer Graphics, vol. 14, no. 1, pp. 97-108, Jan./Feb. 2008.
[8] P.-C. Hung, "Tetrahedral Division Technique Applied to Colorimetric Calibration for Imaging Media," Ann. Meeting IS and T, pp. 419-422, May 1992.
[9] J. Koch, N. Henrich, and S. Müller, "Spatial Color Confidence for Physically Based Rendering Settings on LC Displays," Proc. Int'l Conf. Computer Graphics Theory and Applications (GRAPP '10), 2010.
[10] C. Menk, E. Jundt, and R. Koch, "Evaluation of Geometric Registration Methods for Using Spatial Augmented Reality in the Automotive Industry," Proc. 15th Int'l Workshop Vision, Modeling and Visualization, 2010.
[11] C. Menk, E. Jundt, and R. Koch, "Visualization Techniques for Using Spatial Augmented Reality in the Design Process of a Car," Computer Graphics Forum, vol. 30, pp. 2354-2366, 2011.
[12] C. Menk and R. Koch, "Physically-Based Augmentation of Real Objects with Virtual Content under the Influence of Ambient Light," Proc. IEEE Int'l Workshop Projector-Camera Systems, 2010.
[13] C. Menk and R. Koch, "Interactive Visualization Technique for Truthful Color Reproduction in Spatial Augmented Reality Applications," Proc. IEEE 10th Symp. Mixed and Augmented Reality, 2011.
[14] S.K. Nayar, H. Peri, M.D. Grossberg, and P.N. Belhumeur, "A Projection System with Radiometric Compensation for Screen Imperfections." Proc. Int'l Workshop Projector-Camera Systems, 2003.
[15] S.G. Parker, J. Bigler, A. Dietrich, H. Friedrich, J. Hoberock, D. Luebke, D. McAllister, M. McGuire, K. Morley, A. Robison, and M. Stich, "Optix: A General Purpose Ray Tracing Engine," ACM Trans. Graphics, vol. 29, Aug. 2010.
[16] R. Raskar, G. Welch, and H. Fuchs, "Spatially Augmented Reality," Proc. First Int'l Workshop Augmented Reality, Nov. 1998.
[17] R. Raskar, G. Welch, K.-L. Low, and D. Bandyopadhyay, "Shader Lamps: Animating Real Objects with Image-Based Illumination," Proc. 12th Eurographics Workshop Rendering Techniques, pp. 89-102, 2001.
[18] P. Sen, B. Chen, G. Garg, S.R. Marschner, M. Horowitz, M. Levoy, and H.P.A. Lensch, "Dual Photography," Proc. ACM SIGGRAPH Papers, pp. 745-755, 2005.
[19] G. Sharma and H.J. Trussell, "Digital Color Imaging," IEEE Trans. Image Processing, vol. 6, no. 7, pp. 901-932, July 1997.
[20] Y. Sheng, T.C. Yapo, and B. Cutler, "Global Illumination Compensation for Spatially Augmented Reality," Computer Graphics Forum, vol. 29, pp. 387-396, May 2010.
[21] J.-B. Thomas, P. Colantoni, J.Y. Hardeberg, I. Foucherot, and P. Gouton, "An Inverse Display Color Characterization Model Based on an Optimized Structure," Color Imaging XIII: Processing, Hardcopy, and Applications, vol. 6807, pp. 68070A-68070A, Jan. 2008.
[22] D. Wang, I. Sato, T. Okabe, and Y. Sato, "Radiometric Compensation in a Projector-Camera System Based Properties of Human Vision System," Proc. IEEE CS Int'l Workshop Projector-Camera Systems, p. 100, 2005.
[23] G.J. Ward, "The Radiance Lighting Simulation and Rendering System," Proc. SIGGRAPH '94, pp. 459-472, 1994.
[24] G. Wetzstein and O. Bimber, "Radiometric Compensation through Inverse Light Transport," Proc. 15th Pacific Conf. Computer Graphics and Applications (PG '07), pp. 391-399, 2007.
[25] T. Yoshida, C. Horii, and K. Sato, "A Virtual Color Reconstruction System for Real Heritage with Light Projection," Proc. Int'l Conf. Virtual Systems and Multimedia (VSMM '03), pp. 161-168, 2003.
28 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool