The Community for Technology Leaders
RSS Icon
Issue No.09 - September (2010 vol.32)
pp: 1537-1552
Mingli Song , Zhejiang University, Hangzhou
Dacheng Tao , Nanyang Technological University, Singapore
Chun Chen , Zhejiang University, Hangzhou
Xuelong Li , Birkbeck College, University of London, London
Chang Wen Chen , University at Buffalo, The State University of New York, Buffalo
Both commercial and scientific applications often need to transform color images into gray-scale images, e.g., to reduce the publication cost in printing color images or to help color blind people see visual cues of color images. However, conventional color to gray algorithms are not ready for practical applications because they encounter the following problems: 1) Visual cues are not well defined so it is unclear how to preserve important cues in the transformed gray-scale images; 2) some algorithms have extremely high time cost for computation; and 3) some require human-computer interactions to have a reasonable transformation. To solve or at least reduce these problems, we propose a new algorithm based on a probabilistic graphical model with the assumption that the image is defined over a Markov random field. Thus, color to gray procedure can be regarded as a labeling process to preserve the newly well--defined visual cues of a color image in the transformed gray-scale image. Visual cues are measurements that can be extracted from a color image by a perceiver. They indicate the state of some properties of the image that the perceiver is interested in perceiving. Different people may perceive different cues from the same color image and three cues are defined in this paper, namely, color spatial consistency, image structure information, and color channel perception priority. We cast color to gray as a visual cue preservation procedure based on a probabilistic graphical model and optimize the model based on an integral minimization problem. We apply the new algorithm to both natural color images and artificial pictures, and demonstrate that the proposed approach outperforms representative conventional algorithms in terms of effectiveness and efficiency. In addition, it requires no human-computer interactions.
Color to gray, probabilistic graphical model, visual cue.
Mingli Song, Dacheng Tao, Chun Chen, Xuelong Li, Chang Wen Chen, "Color to Gray: Visual Cue Preservation", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.32, no. 9, pp. 1537-1552, September 2010, doi:10.1109/TPAMI.2009.74
[1] K. Rasche, R. Geist, and J. Westall, "Detail Preserving Reproduction of Colour Images for Monochromats and Dichromats," IEEE Computer Graphics and Applications, vol. 25, no. 3, pp. 22-30, May/June 2005.
[2] A. Gooch, J. Tumblin, and B. Gooch, "Color2gray: Salience-Preserving Colour Removal," ACM Trans. Graphics, vol. 24, no. 3, pp. 634-639, 2005.
[3] R. Brown, "Photoshop Tips: Converting Colour to Black-and-White," http://www.russellbrown.comtips_tech.html , 2006.
[4] G. Wyszecki and W.S. Stiles, Colour Science: Concepts and Methods, Quantitative Data and Formulae. Wiley Interscience, 2000.
[5] H.R. Wu and K.R. Rao, Digital Video Image Quality and Perceptual Coding. CRC Press, 2001.
[6] R. Bala and K. Braun, "Color-to-Grayscale Conversion to Maintain Discriminabillity," Proc. SPIE, pp. 196-202, 2004.
[7] K. Rasche, R. Geist, and J. Westall, "Re-Colouring Images for Gamuts of Lower Dimension," Computer Graphics Forum, vol. 24, no. 3, pp. 423-432, 2005.
[8] I.T. Jolliffe, Principle Component Analysis. Springer, 2002.
[9] S. Mika, B. Schölkopf, A. Smola, K.-R. Müller, M. Scholz, and G. Rätsch, "Kernel PCA and De-Noising in Feature Spaces," Advances in Neural Information Processing Systems, vol. 11, pp. 536-542, MIT Press, 1999.
[10] K.I. Kim, M.O. Franz, and B. Scholkopf, "Iterative Kernel Principal Component Analysis for Image Modeling," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 9, pp. 1351-1366, Sept. 2005.
[11] D. Socolinsky and L. Wolff, "Multispectral Image Visualization through First-Order Fusion," IEEE Trans. Image Processing, vol. 11, no. 8, pp. 923-931, Aug. 2002.
[12] I. Borg and P. Groenen, Modern Multidimensional Scaling: Theory and Applications. Springer-Verlag, 1997.
[13] E. Reinhard, M. Ashikhmin, B. Gooch, and P. Shirley, "Colour Transfer between Images," IEEE Computer Graphics and Applications, vol. 21, no. 5, pp. 34-41, Sept./Oct. 2001.
[14] Y.-W. Tai, J. Jia, and C.-K. Tang, "Soft Color Segmentation and Its Applications," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 9, pp. 1520-1537, Sept. 2007.
[15] G.R. Greenfield and D.H. House, "Image Recolouring Induced by Palette Colour Associations," J. Winter School of Computer Graphics and CAD Systems, vol. 11, no. 1, pp. 3-7, 2003.
[16] D.L. Ruderman, T.W. Cronin, and C.-C. Chiao, "Statistics of Cone Responses to Natural Images: Implications for Visual Coding," J. Optical Soc. of Am., A, vol. 15, no. 8, pp. 2036-2045, 1998.
[17] D. Malacara, Colour Vision and Colourimetry Theory and Applications. SPIE Press, 2002.
[18] J. Vogel and B. Schiele, "Semantic Modeling of Natural Scenes for Content-Based Image Retrieval," Int'l J. Computer Vision, vol. 72, no. 2, pp. 133-157, 2007.
[19] C.E. Guo, S.C. Zhu, and Y.N. Wu, "Primal Sketch: Integrating Texture and Structure," Computer Vision and Image Understanding, vol. 106, no. 1, pp. 5-19, 2007.
[20] D. Slater and G. Healey, "The Illumination Invariant Matching of Deterministic Local Structure in Color Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 10, pp. 1146-1151, Oct. 1997.
[21] M.A. Ruzon and C. Tomasi, "Edge, Junction, and Corner Detection Using Color Distributions," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 11, pp. 1281-1295, Nov. 2001.
[22] D.R. Martin, C.C. Fowlkes, and J. Malik, "Learning to Detect Natural Image Boundaries Using Local Brightness, Color, and Texture Cues," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 5, pp. 530-549, May 2004.
[23] R. Fattal, D. Lischinski, and M. Werman, "Gradient Domain High Dynamic Range Compression," ACM Trans. Graphics, vol. 21, no. 3, pp. 249-256, 2002.
[24] G. Sapiro, Geometric Partial Differential Equation and Image Analysis. Cambridge Univ. Press, 2001.
[25] T.A. Davis, "Umfpack Version 4.1 User Guide," Technical Report TR-03-008, Univ. of Florida, 2003.
[26] W.H. Press, S.A. Teukolsk, W.T. Vetterling, and B.P. Flannery, Numerical Recipes in C: The Art of Scientific Computing, second ed. Cambridge Univ. Press, 1992.
[27] J. Bolz, I. Farmer, E. Grinspun, and P. Schröder, "Sparse Matrix Solvers on the GPU: Conjugate Gradients and Multigrid," ACM Trans. Graphics, vol. 22, no. 3, pp. 917-924, 2003.
[28] H.A. David, The Method of Paired Comparisons. Oxford Univ. Press, 1988.
[29] K. Smith, P.-E. Landes, J. Thollot, and K. Myszkowski, "Apparent Grayscale: A Simple and Fast Conversion to Perceptually Accurate Images and Video," Computer Graphics Forum, vol. 27, no. 2, pp. 193-200, 2008.
[30] R. Mantiuk, K. Myszkowski, and H.-P. Seidel, "A Perceptual Framework for Contrast Processing of High Dynamic Range Images," ACM Trans. Applied Perception, vol. 3, no. 3, pp. 286-308, 2006.
[31] R. Bala and R. Eschbach, "Spatial Color-to-Grayscale Transformation Preserving Chrominance Edge Information," Proc. IS&T/SID 12th Color Imaging Conf., pp. 82-86, 2004.
[32] A. Alsam and Ø. Kolås, "Grey Colour Sharpening," Proc. IS&T/SID 14th Color Imaging Conf., pp. 263-267, 2006.
17 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool