The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.05 - May (2011 vol.33)
pp: 917-930
Eduard Vazquez , Universitat Autonoma de Barcelona, Barcelona
Ramon Baldrich , Universitat Autonoma de Barcelona, Barcelona
Joost van de Weijer , Universitat Autonoma de Barcelona, Barcelona
Maria Vanrell , Universitat Autonoma de Barcelona, Barcelona
ABSTRACT
The segmentation of a single material reflectance is a challenging problem due to the considerable variation in image measurements caused by the geometry of the object, shadows, and specularities. The combination of these effects has been modeled by the dichromatic reflection model. However, the application of the model to real-world images is limited due to unknown acquisition parameters and compression artifacts. In this paper, we present a robust model for the shape of a single material reflectance in histogram space. The method is based on a multilocal creaseness analysis of the histogram which results in a set of ridges representing the material reflectances. The segmentation method derived from these ridges is robust to both shadow, shading and specularities, and texture in real-world images. We further complete the method by incorporating prior knowledge from image statistics, and incorporate spatial coherence by using multiscale color contrast information. Results obtained show that our method clearly outperforms state-of-the-art segmentation methods on a widely used segmentation benchmark, having as a main characteristic its excellent performance in the presence of shadows and highlights at low computational cost.
INDEX TERMS
Segmentation, color.
CITATION
Eduard Vazquez, Ramon Baldrich, Joost van de Weijer, Maria Vanrell, "Describing Reflectances for Color Segmentation Robust to Shadows, Highlights, and Textures", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.33, no. 5, pp. 917-930, May 2011, doi:10.1109/TPAMI.2010.146
REFERENCES
[1] K. Fukunaga and L.D. Hostetler, “The Estimation of the Gradient of a Density Function, with Applications in Pattern Recognition,” IEEE Trans. Information Theory, vol. 21, no. 1, pp. 32-40, Jan. 1975.
[2] Y. Ohta, T. Kanade, and T. Sakai, “Color Information for Region Segmentation,” Computer Graphics and Image Processing, vol. 13, no. 3, pp. 222-241, 1980.
[3] S. Shafer, “Using Color to Separate Reflection Components,” Color Research and Application, vol. 10, no. 4, pp. 210-218, 1985.
[4] I. Gath and A.B. Geva, “Unsupervised Optimal Fuzzy Clustering,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 7, pp. 773-780, July 1989.
[5] R. Bajcsy, S.W. Lee, and A. Leonardis, “Color Image Segmentation with Detection of Highlights and Local Illumination Induced by Inter-Reflections,” Proc. 10th Int'l Conf. Pattern Recognition, vol. 1, pp. 785-790, 1990.
[6] G. Klinker and S. Shafer, “A Physical Approach to Color Image Understanding,” Int'l J. Computer Vision, vol. 4, pp. 7-38, 1990.
[7] T. Pavlidis and Y.T. Liow, “Integrating Region Growing and Edge Detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 3, pp. 225-233, Mar. 1990.
[8] L. Vincent and P. Soille, “Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 6, pp. 583-598, June 1991.
[9] T.N. Pappas, “An Adaptive Clustering Algorithm for Image Segmentation,” IEEE Trans. Signal Processing, vol. 40, no. 4, pp. 901-914, Apr. 1992.
[10] J.M. Gauch and S.M. Pizer, “Multiresolution Analysis of Ridges and Valleys in Grey-Scale Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 6, pp. 635-646, June 1993.
[11] L. Wang and T. Pavlidis, “Direct Gray-Scale Extraction of Features for Character Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 10, pp. 1053-1067, Oct. 1993.
[12] C.A. Bouman and M. Shapiro, “DA Multiscale Random Field Model for Bayesian Image Segmentation,” IEEE Trans. Image Processing, vol. 3, no. 2, pp. 162-177, Mar. 1994.
[13] W. Skarbek and A. Koschan, “Colour Image Segmentation—A Survey,” technical report, Inst. for Technical Informatics, Technical Univ. of Berlin, Oct. 1994.
[14] Q. Huang and B. Dom, “Quantitative Methods of Evaluating Image Segmentation,” Proc. IEEE Int'l Conf. Image Processing, vol. 3, pp. 53-56, 1995.
[15] B.A. Maxwell and S.A. Shafer, “Physics-Based Segmentation of Complex Objects Using Multiple Hypotheses of Image Formation,” Computer Vision and Image Understanding, vol. 65, no. 2, pp. 269-295, 1997.
[16] K. Haris, S.N. Efstratiadis, N. Maglaveras, and A.K. Katsaggelos, “Hybrid Image Segmentation Using Watersheds and Fast Region Merging,” IEEE Trans. Image Processing, vol. 7, no. 12, pp. 1684-1699, Dec. 1998.
[17] L. Itti, C. Koch, and E. Niebur, “A Model of Saliency-Based Visual Attention for Rapid Scene Analysis,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
[18] C.K. Ong and T. Matsuyama, “Robust Color Segmentation Using the Dichromatic Reflection Model,” Proc. 14th Int'l Conf. Pattern Recognition, vol. 1, pp. 780-784, 1998.
[19] O. Chapelle, P. Haffner, and V. Vapnik, “Support Vector Machines for Histogram-Based Image Classification,” IEEE Trans. Neural Networks, vol. 10, no. 5, pp. 1055-1064, Sept. 1999.
[20] A.M. López, F. Lumbreras, J. Serrat, and J.J. Villanueva, “Evaluation of Methods for Ridge and Valley Detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 4, pp. 327-335, Apr. 1999.
[21] P. Schmid, “Segmentation of Digitized Dermatoscopic Images by Two-Dimensional Color Clustering,” IEEE Trans. Medical Imaging, vol. 18, no. 2, pp. 164-171, Feb. 1999.
[22] K. Takahashi and K. Abe, “Color Image Segmentation Using ISODATA Clustering Algorithm,” IEICE Trans. Information and Systems, Pt. 2, vol. J82-D-II, no. 4, pp. 751-762, 1999.
[23] J. Berens and G.D. Finlayson, “Log-Opponent Chromaticity Coding of Color Space,” Proc. 15th Int'l Conf. Pattern Recognition, vol. 1, pp. 206-211, 2000.
[24] H. Cheng, X. Jiang, Y. Sun, and J. Wang, “Color Image Segmentation: Advances and Prospects,” Pattern Recognition, vol. 34, no. 6, pp. 2259-2281, 2001.
[25] J. Shi and J. Malik, “Normalized Cuts and Image Segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 888-905, Aug. 2000.
[26] Y. Deng and B.S. Manjunath, “Unsupervised Segmentation of Color-Texture Regions in Images and Video,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 8, pp. 800-810, Aug. 2001.
[27] L. Lucchese and S. Mitra, “Color Image Segmentation: A State-of-the-Art Survey,” Proc. Indian Nat'l Science Academy, pp. 207-221, 2001.
[28] D. Martin, C. Fowlkes, D. Tal, and J. Malik, “A Database of Human Segmented Natural Images and Its Application to Evaluating Segmentation Algorithms and Measuring Ecological Statistics,” Proc. Eighth Int'l Conf. Computer Vision, vol. 2, pp. 416-423, 2001.
[29] D. Verma and M. Meila, “A Comparison of Spectral Clustering Algorithms,” Technical Report UW-CSE-03-05-01, Univ. of Washington, 2003.
[30] A. Bishnu, P. Bhowmick, S. Dey, B.B. Bhattacharya, M.K. Kundu, C.A. Murthy, and T. Acharya, “Combinatorial Classification of Pixels for Ridge Extraction in a Gray-Scale Fingerprint Image,” Proc. Third Indian Conf. Computer Vision, Graphics and Image Processing, 2002.
[31] H.D. Cheng, X.H. Jiang, and J. Wang, “Color Image Segmentation Based on Homogram Thresholding and Region Merging,” Pattern Recognition, vol. 35, no. 2, pp. 373-393, 2002.
[32] C. Christoudias, B. Georgescu, and P. Meer, “Synergism in Low Level Vision,” Proc. Int'l Conf. Pattern Recognition, vol. 4, pp. 150-155, 2002.
[33] D. Comaniciu and P. Meer, “Mean Shift: A Robust Approach toward Feature Space Analysis,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, May 2002.
[34] M. Egmont-Petersen, D. de Ridder, and H. Handels, “Image Processing with Neural Networks—A Review,” Pattern Recognition, vol. 35, no. 10, pp. 2279-2301, 2002.
[35] J. Freixenet, X. Munoz, D. Raba, J. Mart, and X. Cuf, “Yet Another Survey on Image Segmentation: Region and Boundary Information Integration,” Proc. Seventh European Conf. Computer Vision— Part III, pp. 408-422, 2002.
[36] C. Fowlkes, D. Martin, and J. Malik, “Learning Affinity Functions for Image Segmentation: Combining Patch-Based and Gradient-Based Approaches,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. 2, 2003.
[37] P. Felzenszwalb and D. Huttenlocher, “Efficient Graph-Based Image Segmentation,” Int'l J. Computer Vision, vol. 59, no. 2, pp. 167-181, 2004.
[38] D.W. Kim, K.H. Lee, and D. Lee, “A Novel Initialization Scheme for the Fuzzy C-Means Algorithm for Color Clustering,” Pattern Recognition Letters, vol. 25, no. 2, pp. 227-237, 2004.
[39] D.P. Nikolaev and P.P. Nikolayev, “Linear Color Segmentation and Its Implementation,” Computer Vision and Image Understanding, vol. 94, nos. 1-3, pp. 115-139, 2004.
[40] I. Omer and M. Werman, “Color Lines: Image Specific Color Representation,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 946-953, 2004.
[41] M. Sezgin and B. Sankur, “Survey over Image Thresholding Techniques and Quantitative,” J. Electronic Imaging, vol. 13, no. 1, pp. 146-165, 2004.
[42] F.J. Staal, M.D. Abramoff, M. Niemeijer, M.A. Viergever, and B. van Ginneken, “Ridge-Based Vessel Segmentation in Color Images of the Retina,” IEEE Trans. Medical Imaging, vol. 23, no. 4, pp. 501-509, Apr. 2004.
[43] E.A. Abdel-Hakim and A.F. Aly, “Color Segmentation Using an Eigen Color Representation,” Proc. Eighth Int'l Conf. Information Fusion, vol. 2, pp. 1576-1583, 2005.
[44] S. Agarwal, S. Madasu, M. Hanmandlu, and S. Vasikarla, “A Comparison of Some Clustering Techniques via Color Segmentation,” Proc. Int'l Conf. Information Technology: Coding and Computing, vol. 2, pp. 147-153, 2005.
[45] J.E. Cates, R.T. Whitaker, and G.M. Jones, “Case Study: An Evaluation of User-Assisted Hierarchical Watershed Segmentation,” Medical Image Analysis, vol. 9, no. 6, pp. 566-578, 2005.
[46] J.M. Geusebroek, G.J. Burghouts, and A.W.M. Smeulders, “The Amsterdam Library of Object Images,” Int'l J. Computer Vision, vol. 61, no. 1, pp. 103-112, 2005.
[47] C. Pantofaru and M. Hebert, “A Comparison of Image Segmentation Algorithms,” Technical Report CMU-RI-TR-05-40, Robotics Inst., Carnegie Mellon Univ., Sept. 2005.
[48] F.Y. Shih and S. Cheng, “Automatic Seeded Region Growing for Color Image Segmentation,” Image and Vision Computing, vol. 23, no. 10, pp. 877-886, 2005.
[49] W. Abd-Almageed and L. Davis, “Density Estimation Using Mixtures of Mixtures of Gaussians,” Proc. Ninth European Conf. Computer Vision, 2006.
[50] K.S. Chuang, H.L. Tzeng, S. Chen, J. Wu, and T.J. Chen, “Fuzzy C-Means Clustering with Spatial Information for Image Segmentation,” Computerized Medical Imaging and Graphics, vol. 30, no. 1, pp. 9-15, 2006.
[51] F. Ge, S. Wang, and T. Liu, “Image-Segmentation Evaluation from the Perspective of Salient Object Extraction,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 1146-1153, 2006.
[52] A. Hanbury and B. Marcotegui, “Waterfall Segmentation of Complex Scenes,” Lecture Notes in Computer Science, vol. 3851, pp. 888-897, Springer, 2006.
[53] Z. Kato and T.C. Pong, “A Markov Random Field Image Segmentation Model for Color Textured Images,” Image and Vision Computing, vol. 24, no. 10, pp. 1103-1114, 2006.
[54] L. Macaire, N. Vandenbroucke, and J.G. Postaire, “Color Image Segmentation by Analysis of Subset Connectedness and Color Homogeneity Properties,” Computer Vision and Image Understanding, vol. 102, no. 1, pp. 105-116, 2006.
[55] B. Micusik and A. Hanbury, “Automatic Image Segmentation by Positioning a Seed,” Proc. European Conf. Computer Vision, 2006.
[56] J.C. Pichel, D.E. Singh, and F.F. Rivera, “Image Segmentation Based on Merging of Sub-Optimal Segmentations,” Pattern Recognition Letters, vol. 27, no. 10, pp. 1105-1116, 2006.
[57] J. van de Weijer, T. Gevers, and A.D. Bagdanov, “Boosting Color Saliency in Image Feature Detection,” IEEE Trans. Pattern Recognition and Machine Intelligence, vol. 28, no. 1, pp. 150-156, Jan. 2006.
[58] D. Cremers, M. Rousson, and R. Deriche, “A Review of Statistical Approaches to Level Set Segmentation: Integrating Color, Texture, Motion and Shape,” Int'l J. Computer Vision, vol. 72, no. 2, pp. 195-215, 2007.
[59] M. Donoser and H. Bischof, “ROI-SEG: Unsupervised Color Segmentation by Combining Differently Focused Sub Results,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
[60] F. Ge, S. Wang, and T. Liu, “New Benchmark for Image Segmentation Evaluation,” J. Electronic Imaging, vol. 16, p. 033011, 2007.
[61] T. Liu, J. Sun, N.N. Zheng, X. Tang, and H.Y. Shum, “Learning to Detect a Salient Object,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
[62] Y. Ma, H. Derksen, W. Hong, and J. Wright, “Segmentation of Multivariate Mixed Data via Lossy Data Coding and Compression,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 9, pp. 1546-1562, Sept. 2007.
[63] E. Vazquez, R. Baldrich, J. Vazquez, and M. Vanrell, “Topological Histogram Reduction towards Colour Segmentation,” Proc. Iberian Conf. Pattern Recognition and Image Analysis, pp. 55-62, 2007.
[64] Y. Yang, J. Wright, S. Sastry, and Y. Ma, “Unsupervised Segmentation of Natural Images via Lossy Data Compression,” 2007.
[65] G. Heidemann, “Color Segmentation Robust to Brightness Variations by Using B-Spline Curve Modeling,” Image and Vision Computing, vol. 26, no. 2, pp. 211-227, 2008.
[66] C. Kim, B.J. You, M.H. Jeong, and H. Kim, “Color Segmentation Robust to Brightness Variations by Using B-Spline Curve Modeling,” Pattern Recognition, vol. 41, no. 1, pp. 22-37, 2008.
[67] E. Vazquez, J. van de Weijer, and R. Baldrich, “Image Segmentation in the Presence of Shadows and Highlights,” Proc. 10th European Conf. Computer Vision, pp. 1-14, 2008.
[68] P. Wattuya, K. Rothaus, J.S. Prassni, and X. Jiang, “A Random Walker Based Approach to Combining Multiple Segmentations,” Proc. Int'l Conf. Pattern Recognition, pp. 1-4, 2008.
6 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool