This Article 
 Bibliographic References 
 Add to: 
A Region-Based Fuzzy Feature Matching Approach to Content-Based Image Retrieval
September 2002 (vol. 24 no. 9)
pp. 1252-1267

Abstract—This paper proposes a fuzzy logic approach, UFM (unified feature matching), for region-based image retrieval. In our retrieval system, an image is represented by a set of segmented regions, each of which is characterized by a fuzzy feature (fuzzy set) reflecting color, texture, and shape properties. As a result, an image is associated with a family of fuzzy features corresponding to regions. Fuzzy features naturally characterize the gradual transition between regions (blurry boundaries) within an image and incorporate the segmentation-related uncertainties into the retrieval algorithm. The resemblance of two images is then defined as the overall similarity between two families of fuzzy features and quantified by a similarity measure, UFM measure, which integrates properties of all the regions in the images. Compared with similarity measures based on individual regions and on all regions with crisp-valued feature representations, the UFM measure greatly reduces the influence of inaccurate segmentation and provides a very intuitive quantification. The UFM has been implemented as a part of our experimental SIMPLIcity image retrieval system. The performance of the system is illustrated using examples from an image database of about 60,000 general-purpose images.

[1] H. Bandemer and W. Nather, Fuzzy Data Analysis. Kluwer Academic, 1992.
[2] S. Berretti, A. Del Bimbo, and P. Pala, “Retrieval by Shape Similarity with Perceptual Distance and Effective Indexing,” IEEE Trans. Multimedia, vol. 2, no. 4, pp. 225-239, 2000.
[3] A. del Bimbo and P. Pala, “Visual Image Retrieval by Elastic Matching of User Sketches,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 2, pp. 121-132, Feb. 1997.
[4] C. Carson, M. Thomas, S. Belongie, J.M. Hellerstein, and J. Malik, “Blobworld: A System for Region-Based Image Indexing and Retrieval,” Proc. Visual Information Systems, pp. 509-516, June 1999.
[5] I.J. Cox, M.L. Miller, T.P. Minka, and T.V. Papathomas, “The Bayesian Image Retrieval System, PicHunter: Theory, Implementation, and Pychophysical Experiments,” IEEE Trans. Image Processing, vol. 9, no. 1, pp. 20-37, 2000.
[6] I. Daubechies,“Ten lectures on wavelets,” SIAM CBMS-61, 1992.
[7] C. Faloutsos, R. Barber, M. Flicker, J. Hafner, W. Niblack, and W. Equitz, "Efficient and effective querying by image content," J. Intell. Information Systems," vol. 3, pp. 231-262, 1994.
[8] A. Gersho, “Asymptotically Optimum Block Quantization,” IEEE Trans. Information Theory, vol. 25, no. 4, pp. 373-380, 1979.
[9] T. Gevers and A.W.M. Smeulders, “Pictoseek: Combining Color and Shape Invariant Features for Image Retrieval,” IEEE Trans. Image Processing, vol. 9, no. 1, pp. 102-119, 2000.
[10] A. Gupta and R. Jain, “Visual Information Retrieval,” Comm. ACM, vol. 40, no. 5, pp. 70-79, May 1997.
[11] J.A. Hartigan and M.A. Wong, “Algorithm AS136: A k-Means Clustering Algorithm,” Applied Statistics, vol. 28, pp. 100-108, 1979.
[12] F. Hoppner, F. Klawonn, R. Kruse, and T. Runkler, Fuzzy Cluster Analysis: Methods For Classification, Data Analysis and Image Recognition. John Wiley&Sons, 1999.
[13] L. Jia and L. Kitchen, “Object-Based Image Similarity Computation Using Inductive Learning of Contour-Segment Relations,” IEEE Trans. Iamge Processing, vol. 9, no. 1, pp. 80-87, 2000.
[14] S. Kulkarni, B. Verma, P. Sharma, and H. Selvaraj, “Content Based Image Retrieval Using a Neuro-Fuzzy Technique,” Proc. IEEE Int'l Joint Conf. Neural Networks, pp. 846-850, July 1999.
[15] J. Li, J. Z. Wang, and G. Wiederhold, “Classification of Textured and Non-Textured Images Using Region Segmentation,” Proc. Seventh Int'l Conf. Image Processing, pp. 754-757, Sept. 2000.
[16] J. Li, J. Z. Wang, and G. Wiederhold, “IRM: Integrated Region Matching for Image Retrieval,” Proc. Eighth ACM Int'l Conf. Multimedia, pp. 147-156, Oct. 2000.
[17] W.Y. Ma and B.S. Manjunath, “NETRA: A Toolbox for Navigating Large Image Databases,” Proc. IEEE Int'l Conf. Image Processing, 1997.
[18] W.Y. Ma and B.S. Manjunath, “EdgeFlow: A Technique for Boundary Detection and Image Segmentation,” IEEE Trans. Image Processing, vol. 9, no. 8, pp. 1375-1388, 2000.
[19] S. Mehrotra, Y. Rui, M. Ortega-Binderberger, and T.S. Huang, “Supporting Content-Based Queries over Images in MARS,” Proc. IEEE Int'l Conf. Multimedia Computing and Systems, pp. 632-633, June 1997.
[20] T.P. Minka and R.W. Picard, “Interactive Learning with a `Society of Models',” Pattern Recognition, vol. 30, no. 4, pp. 565-581, 1997.
[21] A. Mojsilovic, J. Kovacevic, J. Hu, R.J. Safranek, and S.K. Ganapathy, “Matching and Retrieval Based on the Vocabulary and Grammar of Color Patterns,” IEEE Trans. Image Processing, vol. 9, no. 1, pp. 38-54, 2000.
[22] A. Pentland, R.W. Picard, and S. Sclaroff, “Photobook: Content-Based Manipulation of Image Databases,” Int'l J. Computer Vision, vol. 18, no. 3, pp. 233-254, 1996.
[23] Y. Rubner, L.J. Guibas, and C. Tomasi, “The Earth Mover's Distance, Multi-Dimensional Scaling, and Color-Based Image Retrieval,” Proc. DARPA Image Understanding Workshop, pp. 661-668, May 1997.
[24] C. Schmid and R. Mohr, “Local Grayvalue Invariants for Image Retrieval,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 5, pp. 530-535, May 1997.
[25] G. Sheikholeslami, S. Chatterjee, and A. Zhang, WaveCluster: A Multi-Resolution Clustering Approach for Very Large Spatial Databases Proc. Very Large Date Bases Conf., pp. 428-439, Aug. 1998.
[26] J. Shi and J. Malik, Normalized Cuts and Image Segmentation IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 888-905, Aug. 2000.
[27] J.R. Smith and S.F. Chang, “VisualSEEk: A Fully Automated Content-Based Image Query System,” ACM Multimedia '96, Nov. 1996.
[28] J.R. Smith and C.S. Li, “Image Classification and Querying Using Composite Region Templates,” J. Computer Vision and Image Understanding, vol. 75, nos. 1-2, pp. 165-174, 1999.
[29] D.L. Swets and J. Weng, Using Discriminant Eigenfeatures for Image Retrieval IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 8, pp. 831-836, Aug. 1996.
[30] M. Unser, Texture Classification and Segmentation Using Wavelet Frames IEEE Trans. Image Processing, vol. 4, no. 11, pp. 1549-1560, Nov. 1995.
[31] C. Vertan and N. Boujemaa, “Embedding Fuzzy Logic in Content Based Image Retrieval,” Proc. 19th Int'l Meeting North Am. Fuzzy Information Processing Soc. (NAFIPS '00), pp. 85-89, July 2000.
[32] J.Z. Wang, G. Wiederhold, O. Firschein, and X.W. Sha, “Content-Based Image Indexing and Searching Using Daubechies' Wavelets,” Int'l J. Digital Libraries, vol. 1, no. 4, pp. 311-328, 1998.
[33] J.Z. Wang, J. Li, R. M. Gray, and G. Wiederhold, “Unsupervised Multiresolution Segmentation for Images with Low Depth of Field,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 1, pp. 85-91, Jan. 2001.
[34] J.Z. Wang, J. Li, and G. Wiederhold, SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 9, pp. 947-963, Sept. 2001.
[35] S.C. Zhu and A. Yuille, “Region Competition: Unifying Snakes, Region Growing and Bayes/MDL for Multiband Image Segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, pp. 884-900, 1996.

Index Terms:
Content-based image retrieval, image classification, similarity measure, fuzzified region features, fuzzy data analysis.
Yixin Chen, James Z. Wang, "A Region-Based Fuzzy Feature Matching Approach to Content-Based Image Retrieval," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 9, pp. 1252-1267, Sept. 2002, doi:10.1109/TPAMI.2002.1033216
Usage of this product signifies your acceptance of the Terms of Use.