This Article 
 Bibliographic References 
 Add to: 
Supporting Ranked Boolean Similarity Queries in MARS
November/December 1998 (vol. 10 no. 6)
pp. 905-925

Abstract—To address the emerging needs of applications that require access to and retrieval of multimedia objects, we are developing the Multimedia Analysis and Retrieval System (MARS) [29]. In this paper, we concentrate on the retrieval subsystem of MARS and its support for content-based queries over image databases. Content-based retrieval techniques have been extensively studied for textual documents in the area of automatic information retrieval [40], [4]. This paper describes how these techniques can be adapted for ranked retrieval over image databases. Specifically, we discuss the ranking and retrieval algorithms developed in MARS based on the Boolean retrieval model and describe the results of our experiments that demonstrate the effectiveness of the developed model for image retrieval.

[1] J.R. Bach, C. Fuller, A. Gupta, A. Hampapur, B. Horowitz, R. Humphrey, R. Jain, and C.-f. Shu, "The Virage Image Search Engine: An Open Framework for Image Management," Proc. SPIE Storage and Retrieval for Still Image and Video Databases IV, 1996.
[2] N. Beckmann, H.-P. Kriegel, R. Schneider, and B. Seeger, “The R*-Tree: An Efficient and Robust Access Method for Points and Rectangles,” Proc. ACM SIGMOD Conf. Management of Data, 1990.
[3] K. Beyer, J. Goldstein, R. Ramakrishnan, and U. Shaft, "When Is 'Nearest Neighbor' Meaningful," submitted for publication, 1998.
[4] J.P. Callan, W.B. Croft, and S.M. Harding, "The INQUERY Retrieval System," Proc. Third Int'l Conf. Database and Expert Systems Applications,Valencia, Spain, 1992.
[5] K. Chakrabarti and S. Mehrotra, "High Dimensional Feature Indexing Using Hybrid Trees," Proc. ICDE 15, Int'l Conf. Data Eng., Mar. 1999, to appear.
[6] T. Chang and C.-C.J. Kuo, "Texture Analysis and Classification With Tree-Structured Wavelet Transform," IEEE Trans. Image Processing, vol. 2, no. 4, pp. 429-441, Oct. 1993.
[7] S. Chaudhari and L. Gravano, "Optimizing Queries over Multimedia Repositories," Proc. SIGMOD, 1996.
[8] T. Chiueh, “Content Based Image Indexing,” Proc. 20th Int'l Conf. Very Large Data Bases, pp. 582-593, Sept. 1994.
[9] P. Ciaccia, M. Patella, and P. Zezula, “M-Tree: An Efficient Access Method for Similarity Search in Metric Spaces,” Proc. Int'l Conf. Very Large Data Bases, 1997.
[10] W.F. Cody et al., "Querying Multimedia Data from Multimedia Repositories by Content: The Garlic Project," Proc. VDB-3, Visual Database Systems, 1995.
[11] G. Evangelidis, D. Lomet, and B. Salzberg, "The hbπ-Tree: A Modified hB-Tree Supporting Concurrency, Recovery and Node Consolidation," Proc. VLDB, 1995.
[12] R. Fagin, “Combining Fuzzy Information from Multiple Systems,” Proc. ACM Symp. Principles of Database Systems (PODS), pp. 216-226, June 1996.
[13] R. Fagin and E.L. Wimmers, "Incorporating User Preferences in Multimedia Queries," Int'l Conf. Database Theory, 1997.
[14] C. Faloutsos, M. Flocker, W. Niblack, D. Petkovic, W. Equitz, and R. Barber, "Efficient and Effective Querying By Image Content," IBM Research Report No. RJ 9453 (83074), Aug. 1993.
[15] C. Faloutsos, M. Ranganathan, and I. Manolopoulos, “Fast Subsequence Matching in Time Series Databases,” Proc. ACM SIGMOD, pp. 419-429, May 1994.
[16] M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker, “Query by Image and Video Content: The QBIC System,” IEEE Computer, 1995.
[17] J.D. Foley,A. van Dam,S.K. Feiner,, and J.F. Hughes,Computer Graphics: Principles and Practice,Menlo Park, Calif.: Addison-Wesley, 1990.
[18] G. Graefe, "Encapsulation of Parallelism in the Volcano Query Processing System," Proc. SIGMOD, ACM, 1990.
[19] G. Graefe, "Query Evaluation Techniques for Large Databases," ACM Computing Surveys, vol. 25, no. 2, pp. 73-170, June 1993.
[20] M.H. Gross, R. Koch, L. Lippert, and A. Dreger, "Multiscale Image Texture Analysis in Wavelet Spaces," Proc. IEEE Int'l Conf. Image Processing, 1994.
[21] A. Gupta and R. Jain, “Visual Information Retrieval,” Comm. ACM, vol. 40, no. 5, pp. 70-79, May 1997.
[22] A. Guttman, “R-Trees: A Dynamic Index Structure for Spatial Searching,” Proc. ACM SIGMOD Conf. Management of Data, 1984.
[23] R.M. Haralick, K. Shanmugam, and I. Dinstein, "Texture Features for Image Classification," IEEE Trans. Systems, Man, and Cybernetics,, vol. 3, no. 6, 1973.
[24] A.K. Jain and A. Vailaya, "Image Retrieval Using Color and Shape," Pattern Recognition, vol. 29, no. 8, 1996.
[25] A. Kundu and J.-L. Chen, "Texture Classification Using QMF Bank-Based Subband Decomposition, CVGIP: Graphical Models and Image Processing, vol. 54, no. 5, pp. 369-384, Sept. 1992.
[26] A. Laine and J. Fan, “Texture Classification by Wavelet Packet Signature,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 11, pp. 1,186-1,191, Nov. 1993.
[27] K. Lin, H.V. Jagadish, and C. Faloutsos, “The TV-Tree: An Index Structure for High-Dimensional Data,” VLDB J., vol. 3, pp. 517-542, 1995.
[28] B.S. Manjunath and W.Y. Ma, "Texture Features for Browsing and Retrieval of Image Data," Technical Report No. TR-95-06, CIPR, July 1995.
[29] S. Mehrotra, K. Chakrabarti, M. Ortega, Y. Rui, and T.S. Huang, "Towards Extending Information Retrieval Techniques for Multimedia Retrieval," Proc. Third Int'l Workshop Multimedia Information Systems,Como, Italy, 1997.
[30] T.P. Minka and R.W. Picard, "Interactive Learning Using a 'Society of Models'," Technical Report No. 349, Media Lab, MIT, 1996.
[31] M. Miyahara et al., "Mathematical Transform of (R, G, B) Color Data to Munsell (H, V, C) Color Data," Proc. Visual Comm. and Image Processing, vol. 1,001, SPIE, 1988.
[32] M. Ortega, K. Chakrabarti, K. Porkaew, and S. Mehrotra, "Cross Media Validation in a Multimedia Retrieval System," Proc. Digital Libraries Workshop on Metrics in Digital Libraries, ACM, 1998.
[33] A. Pentland, R.W. Picard, and S. Sclaroff, "Photobook: Tools for Content-Based Manipulation of Image Databases," Proc. Storage and Retrieval for Image and Video Databases," vol. 2, pp. 34-47, SPIE, Bellingham, Wash., 1994.
[34] J.T. Robinson, “The K-D-B-Tree: A Search Structure for Large Multidimensional Dynamic Indexes,” Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 10-18, 1981.
[35] Y. Rui, T.S. Huang, and S. Mehrotra, "Content-Based Image Retrieval with Relevance Feedback in MARS," Proc. IEEE ICIP Int'l Conf. Image Processing, 1997.
[36] Y. Rui, T.S. Huang, S. Mehrotra, and M. Ortega, "Automatic Matching Tool Selection via Relevance Feedback in MARS," Proc. Second Int'l Conf. Visual Information Systems, 1997.
[37] Y. Rui, T.S. Huang, S. Mehrotra, and M. Ortega, A Relevance Feedback Architecture for Content-Based Multimedia Information Retrieval System Proc. IEEE Workshop Content-Based Access of Images and Video Libraries, pp. 82-89, 1997.
[38] Y. Rui, A.C. She, and T.S. Huang, "Modified Fourier Descriptors for Shape Representation—A Practical Approach," Proc. First Int'l Workshop Image Databases and Multimedia Search,Amsterdam, 1996.
[39] G. Salton, E.A. Fox, and H. Wu, “Extended Boolean Information Retrieval,” Comm. ACM, vol. 26, pp. 1022-1036, Dec. 1983.
[40] G. Salton and M. McGill, Introduction to Modern Information Retrieval, McGraw Hill, New York, 1983.
[41] T. Sellis, N. Roussopoulos, and C. Faloutsos, “The R+-Tree: A Dynamic Index for Multidimensional Objects,” Proc. 13th Int'l Conf. Very Large Data Bases (VLDB), 1987.
[42] J.R. Smith and S.-F. Chang, "Tools and Techniques for Color Image Retrieval," Proc. IS&T, Storage and Retrieval for Image and Video Databases, vol. 2,670, SPIE, 1994.
[43] J.R. Smith and S. Chang, “Transform Features For Texture Classification and Discrimination in Large Image Databases,” Proc. IEEE Int'l Conf. Image Processing, pp. 407-411, 1994.
[44] J.R. Smith and S.-F. Chang, “Single Color Extraction and Image Query,” Proc. IEEE Int'l Conf. Image Processing, pp. 528-531, 1995.
[45] J.R. Smith and S.F. Chang, “Automated Binary Feature Sets for Image Retrieval,” Proc. Int'l Conf. Acoustics, Speech, and Signal Processing, 1996.
[46] M. Stricker and M. Orengo, "Similarity of Color Images," Proc. Conf Visual Comm. and Image Processing, pp. 381-392, SPIE, 1995.
[47] M.J. Swain and B.H. Ballard, “Color Indexing,” Int'l J. Computer Vision, vol. 7, no. 1, pp. 11-32, 1991.
[48] H. Tamura et al., "Texture Features Corresponding to Visual Perception," IEEE Trans. Systems, Man, and Cybernetics, vol. 8, no. 6, June 1978.
[49] H. Tamura, S. Mori, and T. Yamawaki, "Texture Features Corresponding to Visual Perception," IEEE Trans. Systems, Man, and Cybernetics, vol. 8, no. 6, SMC, 1978.
[50] K.S. Thyagarajan, T. Nguyen, and C. Persons, "A Maximum Likelihood Approach to Texture Classification Using Wavelet Transform," Proc. IEEE ICIP, Int'l Conf. Image Processing, 1994.
[51] C.J. van Rijsbergen, Information Retrieval. London: Butterworths, 1979.
[52] D. White and R. Jain, “Similarity Indexing with the SS-Tree,” Proc. 12th Int'l Conf. Data Eng., 1996.

Index Terms:
Database management, multimedia retrieval, Boolean queries, incremental query processing, ranked retrieval.
Michael Ortega, Yong Rui, Kaushik Chakrabarti, Kriengkrai Porkaew, Sharad Mehrotra, Thomas S. Huang, "Supporting Ranked Boolean Similarity Queries in MARS," IEEE Transactions on Knowledge and Data Engineering, vol. 10, no. 6, pp. 905-925, Nov.-Dec. 1998, doi:10.1109/69.738357
Usage of this product signifies your acceptance of the Terms of Use.