This Article 
 Bibliographic References 
 Add to: 
Segmentation of Color Textures
February 2000 (vol. 22 no. 2)
pp. 142-159

Abstract—This paper describes an approach to perceptual segmentation of color image textures. A multiscale representation of the texture image, generated by a multiband smoothing algorithm based on human psychophysical measurements of color appearance is used as the input. Initial segmentation is achieved by applying a clustering algorithm to the image at the coarsest level of smoothing. The segmented clusters are then restructured in order to isolate core clusters, i.e., patches in which the pixels are definitely associated with the same region. The image pixels representing the core clusters are used to form 3D color histograms which are then used for probabilistic assignment of all other pixels to the core clusters to form larger clusters and categorise the rest of the image. The process of setting up color histograms and probabilistic reassignment of the pixels to the clusters is then propagated through finer levels of smoothing until a full segmentation is achieved at the highest level of resolution.

[1] X. Zhang and B.A. Wandell, “A Spatial Extension of CIELAB for Digital Color Image Reproduction,” Proc. Soc. Information Display Symp., 1996. WWW address: .
[2] B.A. Wandell and X. Zhang, “SCIELAB: A Metric to Predict the Discriminability of Colored Patterns,” Proc. Ninth Workshop Image and Multidimensional Signal Processing, pp. 11-12, 1996.
[3] S. Peleg, J. Naor, R. Hartley, and D. Avnir, “Multiple Resolution Texture Analysis and Classification,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, no. 4, pp. 518-523, 1984.
[4] J.L. Crowley and A.C. Sanderson, “Multiple Resolution Representation and Probabilistic Matching of 2-D Gray-Scale Shape,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, pp. 113-120, 1987.
[5] C.A. Bouman and B. Liu, “Multiple Resolution Segmentation of Textured Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 2, pp. 99-113, Feb. 1991.
[6] S. Lam and H. Ip, “Structural Texture Segmentation Using Irregular Pyramid,” Pattern Recognition Letters, vol. 15, pp. 691-698, 1994.
[7] F. Glazer, “Multilevel Relaxation in Low-Level Computer Vision,” Multiresolution Image Processing and Analysis, A. Rosenfeld, ed., pp. 312-330, Springer, 1984.
[8] D. Terzopoulos, "Image Analysis Using Multigrid Relaxation Methods," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 2, pp. 129-139, Mar. 1986.
[9] D. Zhang, J. Liu, and F. Wan, “Multiresolution Relaxation: Experiments and Evaluations,” Proc. Int'l Conf. Pattern Recognition, pp. 712-714, 1988.
[10] E.R. Hancock, M. Haindl, and J. Kittler, "Multiresolution Edge Labeling Using Hierarchical Relaxation," Proc. 11th Int'l Conf. Patt. Recognition, vol. 2, pp.140-144,Los Alamitos, Calif., 1992.
[11] B. Gidas, "A Renormalization Group Approach to Image Processing Problems," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, pp. 164-180, 1989.
[12] P. Perez and F. Heitz, "Multiscale Markov Random Fields and Constrained Relaxation in Low-Level Image Analysis," Proc. 17th IEE Conf. Acoustics, Speech and Signal Processing, pp. III-61-III-64,San Francisco, Mar. 1992.
[13] F. Heitz and P. Bouthemy, Multimodal Estimation of Discontinuous Optical Flow Using Markov Random Fields IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 12, pp. 1217-1232, Dec. 1993.
[14] D.K. Panjwani and G. Healey,“Unsupervised segmentation of textured color images using Markov random fields,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 776-777,New York, June 1993.
[15] F. Heitz, P. Perez, and P. Bouthemy, “Multiscale Minimization of Global Energy Functions in Some Visual Recovery Problems,” Computer Vision, Graphics, and Image Processing: Image Understanding, vol. 59, pp. 125-136, 1994.
[16] S. Krishnamachari and R. Chellappa, “Multiresolution Gauss-Markov Random Field Models for Texture Segmentation,” IEEE Trans. Image Processing, vol. 6, no. 2, pp. 251-267, 1997.
[17] W.Y. Ma and B.S. Manjunath, “Edge Flow: A Framework of Boundary Detection and Image Segmentation,” Proc. Computer Vision and Pattern Recognition, pp. 744-749, 1997.
[18] B. Julesz and J.R. Bergen, “Textons, the Fundamental Elements in Preattentive Vision and Perception of Textures,” Bell Systems Technical J., vol. 62, no. 6, pp. 1,619-1,645, 1983.
[19] J. Malik and P. Perona, “A Computational Model of Texture Perception,” Technical Report CSD-89-491, Univ. of California, Berkeley, 1989.
[20] H. Tamura, S. Mori, and T. Yamawaki, “Textural Features Corresponding to Visual Perception,” IEEE Trans. Systems, Man, and Cybernetics, vol. 8, no. 6, pp. 460-473, June 1978.
[21] A.R. Rao and G.L. Lohse, "Identifying High Level Features of Texture Perception," CVGIP: Graphical Models and Image Processing, Vol. 55, No. 3, 1993, pp. 218-233.
[22] R.M. Haralick, “Statistical and Structural Approaches to Texture,” Proc. IEEE, vol. 67, no. 5, pp. 786-804, 1979.
[23] L.V. Gool, P. Dewaele, and A. Oosterlinck, “Texture Analysis anno 1983,” Computer Vision, Graphics, and Image Processing, vol. 29, pp. 336-357, 1985.
[24] T.R. Reed and J.M.H. du Buf,“A review of recent texture segmentation and feature extraction techniques,” Computer Vision, Graphics, and Image Process, vol. 57, pp. 359-372, May 1993.
[25] A.K. Jain and F. Farrokhnia, “Unsupervised Texture Segmentation Using Gabor Filters,” Pattern Recognition, vol. 24, no. 12, pp. 1167-1186, 1991.
[26] M. Unser and M. Eden,“Multiresolution feature extraction and selection for texture segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 7, pp. 717-728, 1989.
[27] I. Matalas, S. Roberts, and H. Hatzakis, “A Set of Multiresolution Texture Features Suitable for Unsupervised Image Segmentation,” Proc. Signal Processing VIII, Theories and Applications, vol. III, pp. 1,495-1,498, 1996.
[28] C.S. Won and H. Derin, "Unsupervised Segmentation of Noisy and Textured Images Using Markov Random Fields," Computer Vision Graphics and Image Processing, vol. 4, pp. 308-328, 1992.
[29] S.J. Roan, J.K. Aggarwal, and W.N. Martin, “Multiple Resolution Imagery and Texture Analysis,” Pattern Recognition, vol. 20, no. 1, pp. 17-31, 1987.
[30] Y. Ohta, T. Kanade, and T. Sakai, “Color Information for Region Segmentation,” Computer Graphics and Image Processing, vol. 13, pp. 222-241, 1980.
[31] M.J. Swain, “Color Indexing,” PhD thesis, Univ. of Rochester, 1990.
[32] G. Healey,“Segmenting images using normalized color,” IEEE Trans. Systems, Man, and Cybernetics, vol. 22, pp. 64-73, Jan. 1992.
[33] C.L. Huang, T.Y. Cheng, and C.C. Chen, “Color Images' Segmentation Using Scale Space Filter and Markov Random Field,” Pattern Recognition, vol. 25, pp. 1,217-1,229, 1992.
[34] G.J. Klinker, A Physical Approach to Color Image Understanding. Wellesley, Mass.: A.K. Peters, 1993.
[35] J. Liu and Y-H. Yang, “Multiresolution Color Image Segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 7, pp. 689-700, July 1994.
[36] W. Skarbek and A. Koschan, “Colour Image Segmentation—A Survey,” technical report, Technical Univ., Berlin, 1994.
[37] N.W. Campbell and B.T. Thomas, “Segmentation of Natural Images Using Self-Organising Feature Maps,” Proc. Seventh British Machine Vision Conf., vol. I, pp. 222-232, 1996.
[38] G.B. Coleman and H.C. Andrews, “Image Segmentation by Clustering,” Proc. IEEE, vol. 67, no. 5, pp. 773-785, 1979.
[39] K.Y. Song, M. Petrou, and J. Kittler, “Defect Detection in Random Color Textures,” Image and Vision Computing, vol. 14, pp. 667-683, 1996.
[40] S.C. Tan and J. Kittler, “Colour Texture Classification Using Features from Color Histogram,” Proc. Eighth Scandinavian Conf. Image Processing, 1993.
[41] J. Scharcanski and J.H. Hovis, “Representing the Color Aspect of Texture Images,” Pattern Recognition Letters, vol. 15, pp. 191-197, 1994.
[42] A. Stoddart, M. Petrou, and J. Kittler, “Probabilistic Relaxation as an Optimiser,” J. Math. Vision, 1998.
[43] R.S. Kashi, T.V. Papathomas, A. Gorea, and B. Julesz, “Similarities between Texture Grouping and Motion Perception: The Role of Color, Luminance, and Orientation,” Int'l J. Imaging Systems and Technology, vol. 7, no. 2, pp. 85-91, 1996.
[44] T.V. Papathomas, R.S. Kashi, and A. Gorea, “A Human Vision-Based Computational Model for Chromatic Texture Segregation,” IEEE Trans. Systems, Man, and Cybernetics, vol. 27, no. 3, pp. 428-440, 1997.
[45] E.R. Hancock and J. Kittler, "Edge-Labeling Using Dictionary-Based Relaxation," IEEE Trans Pattern Analysis and Machine Intelligence, vol. 12, no. 2, pp. 165-181, 1990.
[46] W.J. Christmas, J. Kittler, and M. Petrou, “Structural Matching in Computer Vision Using Probabilistic Relaxation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 8, pp. 749–764, Aug. 1995.
[47] “Vistex Texture Database,” MIT Media Lab, VisionTexturevistex.html, 1995.
[48] M. Mirmehdi and M. Petrou, “Perceptual versus Gaussian Smoothing for Pattern-Color Separability,” Proc. Int'l Conf. Signal Processing and Comm., pp. 136-140, 1998.

Index Terms:
Color segmentation, probabilistic relaxation, perceptual smoothing.
Majid Mirmehdi, Maria Petrou, "Segmentation of Color Textures," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 2, pp. 142-159, Feb. 2000, doi:10.1109/34.825753
Usage of this product signifies your acceptance of the Terms of Use.