The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.12 - Dec. (2012 vol.34)
pp: 2289-2302
Seon Joo Kim , SUNY Korea, Incheon, South Korea
Hai Ting Lin , Sch. of Comput., Nat. Univ. of Singapore, Singapore, Singapore
Zheng Lu , Sch. of Comput., Nat. Univ. of Singapore, Singapore, Singapore
Sabine Süsstrunk , IVRG, EPFL, Lausanne, Switzerland
S. Lin , Microsoft Res. Asia, Beijing, China
M. S. Brown , Sch. of Comput., Nat. Univ. of Singapore, Singapore, Singapore
ABSTRACT
We present a study of in-camera image processing through an extensive analysis of more than 10,000 images from over 30 cameras. The goal of this work is to investigate if image values can be transformed to physically meaningful values, and if so, when and how this can be done. From our analysis, we found a major limitation of the imaging model employed in conventional radiometric calibration methods and propose a new in-camera imaging model that fits well with today's cameras. With the new model, we present associated calibration procedures that allow us to convert sRGB images back to their original CCD RAW responses in a manner that is significantly more accurate than any existing methods. Additionally, we show how this new imaging model can be used to build an image correction application that converts an sRGB input image captured with the wrong camera settings to an sRGB output image that would have been recorded under the correct settings of a specific camera.
INDEX TERMS
image colour analysis, calibration, CCD image sensors, computer vision, image correction application, in-camera imaging model, color computer vision, in-camera image processing, imaging model, radiometric calibration methods, sRGB images, CCD RAW responses, Image color analysis, Cameras, Image processing, Calibration, Radiometry, Computational modeling, white balance, Radiometric calibration, in-camera image processing, gamut mapping
CITATION
Seon Joo Kim, Hai Ting Lin, Zheng Lu, Sabine Süsstrunk, S. Lin, M. S. Brown, "A New In-Camera Imaging Model for Color Computer Vision and Its Application", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.34, no. 12, pp. 2289-2302, Dec. 2012, doi:10.1109/TPAMI.2012.58
REFERENCES
[1] J. Holm, I. Tastl, L. Hanlon, and P. Hubel, "Color Processing for Digital Photography," Colour Eng. Achieving Device Independent Colour, P. Green and L. MacDonald, eds., pp. 79-220, Wiley, 2002.
[2] H. Lin, S.J. Kim, S. Süsstrunk, and M.S. Brown, "Revisiting Radiometric Calibration for Color Computer Vision," Proc. IEEE Int'l Conf. Computer Vision, 2011.
[3] A. Chakrabarti, D. Scharstein, and T. Zickler, "An Empirical Camera Model for Internet Color Vision," Proc. British Machine Vision Conf., 2009.
[4] M. Grossberg and S. Nayar, "Modeling the Space of Camera Response Functions," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 10, pp. 1272-1282, Oct. 2004.
[5] S. Lin and L. Zhang, "Determining the Radiometric Response Function from a Single Grayscale Image," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 66-73, 2005.
[6] S. Mann and R. Picard, "On Being 'Undigital' with Digital Cameras: Extending Dynamic Range by Combining Differently Exposed Pictures," Proc. IS&T 46th Ann. Conf., pp. 422-428, 1995.
[7] T. Mitsunaga and S. Nayar, "Radiometric Self-Calibration," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 374-380, 1999.
[8] P. Debevec and J. Malik, "Recovering High Dynamic Range Radiance Maps from Photographs," Proc. ACM Siggraph, pp. 369-378, 1997.
[9] M. Grossberg and S. Nayar, "Determining the Camera Response from Images: What Is Knowable?" IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 11, pp. 1455-1467, Nov. 2003.
[10] S.J. Kim and M. Pollefeys, "Robust Radiometric Calibration and Vignetting Correction," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 4, pp. 562-576, Apr. 2008.
[11] S. Kuthirummal, A. Agarwala, D. Goldman, and S. Nayar, "Priors for Large Photo Collections and What They Reveal about Cameras," Proc. European Conf. Computer Vision, pp. 74-86, 2008.
[12] C. Pal, R. Szeliski, M. Uyttendaele, and N. Jojic, "Probability Models for High Dynamic Range Imaging," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 173-180, 2004.
[13] S. Lin, J. Gu, S. Yamazaki, and H. Shum, "Radiometric Calibration from a Single Image," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 938-945, 2004.
[14] K. Barnard, V. Cardei, and B. Funt, "A Comparison of Computational Color Constancy Algorithms—Part I: Methodology and Experiments with Synthesized Data," IEEE Trans. Image Processing, vol. 11, no. 9, pp. 972-984, Sept. 2002.
[15] G. Buchsbaum, "A Spatial Processor Model for Object Colour Perception," J. Franklin Inst.-Eng. and Applied Math., vol. 310, pp. 1-26, 1980.
[16] E. Land and J. McCann, "Lightness and Retinex Theory," J. Optical Soc. Am., vol. 61, no. 1, pp. 1-11, 1971.
[17] D. Forsyth, "A Novel Algorithm for Color Constancy," Int'l J. Computer Vision, vol. 5, no. 1, pp. 5-36, 1990.
[18] G.D. Finlayson and S.D. Hordley, "Improving Gamut Mapping Color Constancy," IEEE Trans. Image Processing, vol. 9, no. 10, pp. 1774-1783, Oct. 2000.
[19] D. Brainard and W. Freeman, "Bayesian Color Constancy," J. Optical Soc. Am., vol. 14, no. 7, pp. 1393-1411, 1997.
[20] A. Gijsenij and T. Gevers, "Color Constancy Using Natural Image Statistics," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
[21] E. Reinhard, M. Ashikhmin, B. Gooch, and P. Shirley, "Color Transfer between Images," IEEE Computer Graphics and Applications, vol. 21, no. 5, pp. 34-41, Sept./Oct. 2001.
[22] D. Cohen-Or, O. Sorkine, R. Gal, T. Leyvand, and Y.-Q. Xu, "Color Harmonization," ACM Trans. Graphics, vol. 25, no. 3, pp. 624-630, 2006.
[23] S. Bae, S. Paris, and F. Durand, "Two-Scale Tone Management for Photographic Look," ACM Trans. Graphics, vol. 25, pp. 637-645, 2006.
[24] J.-F. Lalonde, A.A. Efros, and S.G. Narasimhan, "Webcam Clip Art: Appearance and Illuminant Transfer from Time-Lapse Sequences," ACM Trans. Graphics, vol. 28, no. 5, pp. 131:1-131:10, 2009.
[25] L. Shapira, A. Shamir, and D. Cohen-Or, "Image Appearance Exploration by Model-Based Navigation," Computer Graphics Forum, vol. 28, no. 2, pp. 629-638, 2009.
[26] B. Wang, Y. Yu, T.-T. Wong, C. Chen, and Y.-Q. Xu, "Data-Driven Image Color Theme Enhancement," ACM Trans. Graphics, vol. 29, no. 6, pp. 146:1-146:10, Dec. 2010.
[27] P.D. Hiscocks, "Measuring Camera Shutter Speed," http://www.syscompdesign.com/AppNotesshutter-cal.pdf , 2010.
[28] ISO 22028-1:2004, "Photography and Graphic Technology— Extended Colour Encodings for Digital Image Storage, Manipulation and Interchange—Part 1: Architecture and Requirements," Int'l Organization for Standardization, 2004.
[29] J. Morovic and M.R. Luo, "The Fundamentals of Gamut Mapping: A Survey," J. Imaging Science and Technology, vol. 45, no. 3, pp. 283-290, 2001.
[30] M.D. Buhmann, Radial Basis Functions: Theory and Implementations. Cambridge Univ. Press, 2003.
[31] J.C. Carr, R.K. Beatson, J.B. Cherrie, T.J. Mitchell, W.R. Fright, and B.C. McCallum, "Reconstruction and Representation of 3D Objects with Radial Basis Functions," Proc. ACM Siggraph, pp. 67-76, 2001.
[32] L. Greengard and V. Rokhlin, "A Fast Algorithm for Particle Simulations," J. Computational Physics, vol. 73, pp. 325-348, 1987.
[33] T. Haber, C. Fuchs, P. Bekaert, H.-P. Seidel, M. Goesele, and H. Lensch, "Relighting Objects from Image Collections," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2008.
18 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool