This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Unsupervised Segmentation of Color-Texture Regions in Images and Video
August 2001 (vol. 23 no. 8)
pp. 800-810

Abstract—A new method for unsupervised segmentation of color-texture regions in images and video is presented. This method, which we refer to as JSEG, consists of two independent steps: color quantization and spatial segmentation. In the first step, colors in the image are quantized to several representative classes that can be used to differentiate regions in the image. The image pixels are then replaced by their corresponding color class labels, thus forming a class-map of the image. The focus of this work is on spatial segmentation, where a criterion for “good” segmentation using the class-map is proposed. Applying the criterion to local windows in the class-map results in the “J-image,” in which high and low values correspond to possible boundaries and interiors of color-texture regions. A region growing method is then used to segment the image based on the multiscale J-images. A similar approach is applied to video sequences. An additional region tracking scheme is embedded into the region growing process to achieve consistent segmentation and tracking results, even for scenes with nonrigid object motion. Experiments show the robustness of the JSEG algorithm on real images and video.

[1] S. Belongie, C. Carson, H. Greenspan, and J. Malik, “Color- and Texture-Based Image Segmentation Using EM and Its Application to Content-Based Image Retrieval,” Proc. Int'l Conf. Computer Vision, pp. 675-682, 1998.
[2] M. Borsotti, P. Campadelli, and R. Schettini, “Quantitative Evaluation of Color Image Segmentation Results,” Pattern Recognition Letters, vol. 19, no. 8, pp. 741-748, 1998.
[3] M.M. Chang, A.M. Tekalp, and M.I. Sezan, “Simultaneous Motion Estimation and Segmentation,” IEEE Trans. Image Processing, vol. 6, no. 9, pp. 1326-1333, 1997.
[4] J.G. Choi, S.W. Lee, and S.D. Kim, “Spatio-Temporal Video Segmentation Using a Joint Similarity Measure,” IEEE Trans. Circuits and Systems for Video Technology, vol. 7, no. 2, pp. 279-286, 1997.
[5] D. Comaniciu and P. Meer, Robust Analysis of Feature Spaces: Color Image Segmentation Proc. 1997 IEEE Conf. Computer Vision and Pattern Recognition, pp. 750-755, 1997.
[6] Y. Delignon, A. Marzouki, and W. Pieczynski, Estimation of Generalized Mixture and Its Application in Image Segmentation IEEE Trans. Image Processing, vol. 6, no. 10, pp. 1364-1375, 1997.
[7] Y. Deng and B.S. Manjunath, Content-Based Search of Video Using Color, Texture and Motion Proc. Fourth IEEE Int'l Conf. Image Processing, pp. 543-547, Oct. 1997.
[8] Y. Deng and B.S. Manjunath, “NeTra-V: Toward an Object-Based Video Representation,” IEEE Trans. Circuits and Systems for Video Technology, vol. 8, no. 5, pp. 616-627, 1998.
[9] Y. Deng, C. Kenney, M.S. Moore, and B.S. Manjunath, “Peer Group Filtering and Perceptual Color Image Quantization,” Proc. IEEE Int'l Symp. Circuits and Systems, vol. 4, pp. 21-24, 1999.
[10] R.O. Duda and P.E. Hart, Pattern Classification and Scene Analysis. New York: John Wiley&Sons, 1970.
[11] A. Gersho and R.M. Gray, Vector Quantization and Signal Compression. Boston: Kluwer Academic, 1992.
[12] G. Halevi and D. Weinshall, “Motion of Disturbances: Detection and Tracking of Multi-Body Non-Rigid Motion,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1997.
[13] D.A. Langan, J.W. Modestino, and J. Zhang, “Cluster Validation for Unsupervised Stochastic Model-Based Image Segmentation,” IEEE Trans. Image Processing, vol. 7, no. 2, pp. 180-244, 1997.
[14] W.Y. Ma and B.S. Manjunath, “Edge Flow: A Framework of Boundary Detection and Image Segmentation,” Proc. Computer Vision and Pattern Recognition, pp. 744-749, 1997.
[15] D. Weiskopf, M. Hopf, and T. Ertl, “Hardware-Accelerated Visualization of Time-Varying 2D and 3D Vector Fields by Texture Advection via Programmable Per-Pixel Operations. Vision, Modeling, and Visualization,” Vision, Modeling, and Visualization (VMV '01) Conf. Proc., T. Ertl, B. Girod, G. Greiner, H. Niermann, and H.-P. Seidel, eds., pp. 439-446, 2001.
[16] F. Moscheni, S. Bhattacharjee, and M. Kunt, “Spatiotemporal Segmentation Based on Region Merging,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 9, pp. 897-915, Sept. 1998.
[17] D.K. Panjwani and G. Healey, “Markov Random Field Models for Unsupervised Segmentation of Textured Color Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, pp. 939-954, 1995.
[18] L. Shafarenko, M. Petrou, and J. Kittler, “Automatic Watershed Segmentation of Randomly Textured Color Images,” IEEE Trans. Image Processing, vol. 6, no. 11, pp. 1530-1544, 1997.
[19] J. Shi and J. Malik, “Motion Segmentation and Tracking Using Normalized Cuts,” Proc. Int'l Conf. Computer Vision, 1998.
[20] J. Shi and J. Malik, Normalized Cuts and Image Segmentation IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 888-905, Aug. 2000.
[21] C. Stiller, “Object-Based Estimation of Dense Motion Fields,” IEEE Trans. Image Processing, vol. 6, no. 2, pp. 234-250, Feb. 1997.
[22] D. Wang, "Unsupervised Video Segmentation Based on Watersheds and Temporal Tracking," IEEE Trans. Circuits and Systems for Video Technology, vol. 8, no. 5, Sept. 1998, pp. 539-545.
[23] J.Y.A. Wang and E.H. Adelson, Representing Moving Images with Layers IEEE Trans. Image Processing, vol. 3, no. 5, pp. 625-638, Sept. 1994.
[24] J.-P. Wang, “Stochastic Relaxation on Partitions with Connected Components and Its Application to Image Segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 6, pp. 619-636, 1998.
[25] S.C. Zhu and A. Yuille, “Region Competition: Unifying Snakes, Region Growing and Bayes/MDL for Multiband Image Segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, pp. 884-900, 1996.

Index Terms:
Image segmentation, color segmentation, texture segmentation, video segmentation, spatiotemporal segmentation.
Citation:
Yining Deng, b.s. Manjunath, "Unsupervised Segmentation of Color-Texture Regions in Images and Video," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 8, pp. 800-810, Aug. 2001, doi:10.1109/34.946985
Usage of this product signifies your acceptance of the Terms of Use.