The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.04 - April (2008 vol.30)
pp: 562-576
ABSTRACT
In many computer vision systems, it is assumedthat the image brightness of a point directly reflects the sceneradiance of the point. However, the assumption does not hold inmost cases due to nonlinear camera response function, exposurechanges, and vignetting. The effects of these factors are mostvisible in image mosaics and textures of 3D models wherecolors look inconsistent and notable boundaries exist. In thispaper, we propose a full radiometric calibration algorithm thatincludes robust estimation of the radiometric response function,exposures, and vignetting. By decoupling the effect of vignettingfrom the response function estimation, we approach each processin a manner that is robust to noise and outliers. We verifyour algorithm with both synthetic and real data which showssignificant improvement compared to existing methods. We applyour estimation results to radiometrically align images for seamlessmosaics and 3D model textures. We also use our methodto create high dynamic range (HDR) mosaics which are morerepresentative of the scene than normal mosaics.
INDEX TERMS
Radiometric response function, vignetting, radiometricimage alignment, high dynamic range imaging
CITATION
Seon Joo Kim, Marc Pollefeys, "Robust Radiometric Calibration and Vignetting Correction", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.30, no. 4, pp. 562-576, April 2008, doi:10.1109/TPAMI.2007.70732
REFERENCES
[1] A. Agathos and R. Fisher, “Colour Texture Fusion of Multiple Range Images,” Proc. Int'l Conf. 3-D Digital Imaging and Modeling, pp. 139-146, Oct. 2003.
[2] M. Aggarwal, H. Hua, and N. Ahuja, “On Cosine-Fourth and Vignetting Effects in Real Lenses,” Proc. IEEE Int'l Conf. Computer Vision, pp. 472-479, July 2001.
[3] N. Asada, A. Amano, and M. Baba, “Photometric Calibration of Zoom Lens Systems,” Proc. IEEE Int'l Conf. Pattern Recognition, pp.186-190, Aug. 2001.
[4] C.M. Bastuscheck, “Correction of Video Camera Response Using Digital Techniques,” J. Optical Eng., vol. 26, no. 12, pp. 1257-1262, 1987.
[5] E. Beauchesne and S. Roy, “Automatic Relighting of Overlapping Textures of a 3D Model,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 166-173, June 2003.
[6] M. Brown and D. Lowe, “Recognising Panorama,” Proc. IEEE Int'l Conf. Computer Vision, pp. 1218-1225, Oct. 2003.
[7] P. Burt and E.H. Adelson, “A Multiresolution Spline with Application to Image Mosaics,” ACM Trans. Graphics, vol. 2, no. 4, pp. 217-236, 1983.
[8] Y.P. Chen and B. Mudunuri, “An Anti-Vignetting Technique for Superwide Field of View Mosaicked Images,” J. Imaging Technology, vol. 12, no. 5, pp. 293-295, 1986.
[9] P. Debevec and J. Malik, “Recovering High Dynamic Range Radiance Maps from Photographs,” Proc. ACM SIGGRAPH '97, pp. 369-378, Aug. 1997.
[10] A. Eden, M. Uyttendaele, and R. Szeliski, “Seamless Image Stitching of Scenes with Large Motions and Exposure Differences,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2498-2505, June 2006.
[11] D. Goldman and J. Chen, “Vignette and Exposure Calibration and Compensation,” Proc. IEEE Int'l Conf. Computer Vision, pp. 899-906, Oct. 2005.
[12] M. Grossberg and S. Nayar, “A General Imaging Model and a Method for Finding Its Parameters,” Proc. IEEE Int'l Conf. Computer Vision, pp. 108-115, July 2001.
[13] M. Grossberg and S. Nayar, “Determining the Camera Response from Images: What Is Knowable?” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 11, pp. 1455-1467, Nov. 2003.
[14] M. Grossberg and S. Nayar, “Modeling the Space of Camera Response Functions,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 10, pp. 1272-1282, Oct. 2004.
[15] B.K.P. Horn, Robot Vision. The MIT Press, 1986.
[16] J. Jia and C. Tang, “Tensor Voting for Image Correction by Global and Local Intensity Alignment,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 1, pp. 36-50, Jan. 2005.
[17] S.B. Kang, M. Uyttendaele, S. Winder, and R. Szeliski, “High Dynamic Range Video,” ACM Trans. Graphics, vol. 22, no. 3, pp.319-325, 2003.
[18] S.B. Kang and R. Weiss, “Can We Calibrate a Camera Using an Image of a Flat, Textureless Lambertian Surface?” Proc. European Conf. Computer Vision, pp. 640-653, July 2000.
[19] S.J. Kim and M. Pollefeys, “Radiometric Alignment of Image Sequences,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 645-651, June 2004.
[20] A. Levin, A. Zomet, S. Peleg, and Y. Weiss, “Seamless Image Stitching in the Gradient Domain,” Proc. European Conf. Computer Vision, pp. 377-389, May 2004.
[21] S. Lin, J. Gu, S. Yamazaki, and H. Shum, “Radiometric Calibration from a Single Image,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 938-945, June 2004.
[22] S. Lin and L. Zhang, “Determining the Radiometric Response Function from a Single Grayscale Image,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 66-73, June 2005.
[23] A. Litvinov and Y. Schechner, “Addressing Radiometric Nonidealities: A Unified Framework,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 52-59, June 2005.
[24] A. Litvinov and Y. Schechner, “Radiometric Framework for Image Mosaicking,” J. Optical Soc. Am., vol. 22, no. 5, pp. 839-848, 2005.
[25] S. Mann, “Comparametric Equations with Practical Applications in Quantigraphic Image Processing,” IEEE Trans. Image Processing, vol. 9, no. 8, pp. 1389-1406, 2000.
[26] S. Mann and R. Mann, “Quantigraphic Imaging: Estimating the Camera Response and Exposures from Differently Exposed Images,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 842-849, Dec. 2001.
[27] S. Mann and R. Picard, “On Being “Undigital” with Digital Cameras: Extending Dynamic Range by Combining Differently Exposed Pictures,” Proc. IS&T 46th Ann. Conf., pp. 422-428, May 1995.
[28] T. Mitsunaga and S. Nayar, “Radiometric Self-Calibration,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 374-380, June 1999.
[29] C. Pal, R. Szeliski, M. Uyttendaele, and N. Jojic, “Probability Models for High Dynamic Range Imaging,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 173-180, June 2004.
[30] M. Pollefeys, L.V. Gool, M. Vergauwen, F. Verbiest, K. Cornelis, J. Tops, and R. Koch, “Visual Modeling with a Hand-Held Camera,” Int'l J. Computer Vision, vol. 59, no. 3, pp. 207-232, 2004.
[31] A.A. Sawchuk, “Real-Time Correction of Intensity Nonlinearities in Imaging Systems,” IEEE Trans. Computers, vol. 26, no. 1, pp. 34-39, Jan. 1977.
[32] Y. Schechner and S. Nayar, “Generalized Mosaicing: High Dynamic Range in a Wide Field of View,” Int'l J. Computer Vision, vol. 53, no. 3, pp. 245-267, 2003.
[33] Y. Tsin, V. Ramesh, and T. Kanade, “Statistical Calibration of the CCD Imaging Process,” Proc. IEEE Int'l Conf. Computer Vision, pp.480-487, July 2001.
[34] M. Uyttendaele, A. Criminisi, S.B. Kang, S. Winder, R. Hartley, and R. Szeliski, “Image-Based Interactive Exploration of Real-World Environments,” IEEE Computer Graphics and Applications, vol. 24, no. 3, pp. 52-63, 2004.
[35] W. Yu, “Practical Anti-Vignetting Methods for Digital Cameras,” IEEE Trans. Consumer Electronics, vol. 50, no. 4, pp. 975-983, 2004.
[36] W. Yu, Y. Chung, and J. Soh, “Vignetting Distortion Correction Method for High Quality Digital Imaging,” Proc. IEEE Int'l Conf. Pattern Recognition, pp. 666-669, Aug. 2004.
[37] Y. Zheng, S. Lin, and S.B. Kang, “Single-Image Vignetting Correction,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 461-468, June 2006.
12 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool