| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Distributed and Reactive Query Planning in R-MAGIC: An Agent-Based Multimedia Retrieval System
September 2004 (vol. 16 no. 9)
pp. 1082-1095
This paper presents the planning scheme for a cooperative agent-based multimedia retrieval architecture that integrates a heterogeneous set of repositories into a coherent information system. The agents in the system collaborate in context of a conceptual query to formulate unique retrieval strategies for the different collections. The retrieval plan makes need-based use of independent content analysis tools available on the network. The retrieval strategies for the repositories so formulated satisfy the specified constraints on quality of results and the response time requirements. The retrieval plan is reactively updated based on the retrieval performance at the individual repositories. We present some experimental results to show the effectiveness of the planning scheme for repositories with different characteristics and the scalability of the architecture. We present a prototype implementation of this architecture that integrates a set of dissimilar collections of multimedia data on Indian cultural heritage. A comparison of the retrieval results with some existing Internet search tools proves the effectiveness of the architecture.
[1] H. Ghosh, S. Chaudhury, C. Arora, and P. Nirankari, ImAge: An Extensible Agent Based Architecture for Image Retrieval Int'l J. Digital Libraries, vol. 2, no. 4, pp. 236-250, 2000.
[2] T.-S. Chua, H.-K. Pung, G.-J. Lu, and H.-S. Jong, A Concept Based Image Retrieval System Proc. 27th Ann. Hawaii Int'l Conf. System Sciences, 1994.
[3] E.J. Guglielmo and N.C. Rowe, Natural-Language Retrieval of Images Based on Descriptive Captions IEEE Trans. Information Systems, vol. 14, no. 3, pp. 237-267, July 1996.
[4] S.-F. Chang, J.R. Smith, M. Beigi, and A. Benitez, Visual Information Retrieval from Large Distributed On-Line Repositories Comm. ACM, vol. 40, no. 12, pp. 63-71, Dec. 1997.
[5] M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker, “Query by Image and Video Content: The QBIC System,” IEEE Computer, 1995.
[6] R.J. McNab, L.A. Smith, D. Bainbridge, and I.H. Witten, The New Zealand Digital Library MELody inDEX D-Lib Magazine, vol. 3, no. 5, May 1997.
[7] J.-S.R. Jang and H.-R. Lee, Hierarchical Filtering Method for Content-Based Music Retrieval via Acoustic Input Proc. Ninth ACM Int'l Conf. Multimedia (Multimedia '01), pp. 401-410, 2001.
[8] H. Murase and S.K. Nayar, Visual Learning and Recognition of 3D Objects from Appearance Int'l J. Computer Vision, vol. 14, no. 1, pp. 5-24, 1995.
[9] W.W. Chu, C.C. Hsu, A.F. Cardenas, and R.K. Taira, “Knowledge-Based Image Retrieval with Spatial and Temporal Constructs,” IEEE Trans. Knowledge and Data Eng., vol. 10, no. 6, Nov./Dec. 1998.
[10] C. Colombo, A. Del Bimbo, and P. Pala, "Semantics in Visual Information Retrieval," IEEE MultiMedia, vol. 6, no. 3, July-Sept. 1999, pp. 38-53.
[11] R. Choudhury, J. B. Srivastava, and S. Chaudhury, Reconstruction-Based Recognition of Scenes with Translationally Repeated Quadrics IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 617-632, June 2001.
[12] G. Ahanger and T.D.C. Little, “Automatic Composition Techniques for Video Production,” IEEE Trans. Knowledge and Data Engineering, vol. 10, no. 6, pp. 967-987, Nov./Dec. 1998.
[13] X.S. Zhou and T.S. Huang, Unifying Keywords and Visual Contents in Image Retrieval IEEE Multimedia, vol. 9, no. 2, pp. 23-33, Apr.-June 2002.
[14] R. Leonardi and P. Migliorati, Semantic Indexing of Multimedia Documents IEEE Multimedia, vol. 9, no. 2, pp. 44-51, Apr.-June 2002.
[15] J. Assfalg, M. Bertini, C. Colombo, and A. Del Bimbo, Semantic Annotation of Sports Videos IEEE Multimedia, vol. 9, no. 2, pp. 52-60, Apr.-June 2002.
[16] S. Marcus and V.S. Subrahmanian, Foundations of Multimedia Database Systems J. ACM, vol. 43, no. 3, pp. 474-523, May 1996.
[17] J.Z. Lee, M.T. Ozsu, D. Szafron, and V. Oria, MOQL: A Multimedia Object Query Language Proc. Third Int'l Workshop Multimedia Information Systems, pp. 19-28, Sept. 1997.
[18] V.R. Lesser, "Cooperative Multiagent Systems: A Personal View of the State of the Art," IEEE Trans. Knowledge and Data Eng ., vol. 11, no. 1, Jan./Feb. 1999, pp. 133-142.
[19] P.C. Weinstein, W.P. Birmingham, and E.H. Durfee, Agent-Based Digital Libraries: Decentralization and Coordination IEEE Comm. Magazine, vol. 37, no. 1, pp. 110-115, Jan. 1999.
[20] L.M. Deschaine, R.S. Brice, and M.H. Nodine, Use of InfoSleuth to Coordinate Information Acquisition, Tracking and Analysis in Complex Applications Proc. Advanced Simulation Technologies Conf., Apr. 2000.
[21] S. Bergamaschi, S. Castano, M. Vincini, and D. Beneventano, Semantic Integration of Heterogeneous Information Sources Data and Knowledge Eng., vol. 36, no. 3, pp. 215-249, May/June 2001.
[22] S. Franklin and A. Graesser, Is It an Agent, or Just a Program? A Taxonomy for Autonomous Agents Proc. Third Int'l Workshop Agent Theories Architectures, and Languages, 1996.
[23] A. Muller and U. Thiel, Query Expansion in an Abductive Information Retrieval System Proc. Computer Assisted Information Searching on Internet (RIAO-94), pp. 461-480, 1994.
[24] H. Ghosh, S. Chaudhury, A. Gupta, and S. Gupta, Knowledge Based Query Interpretation for Multimedia Retrieval in an Open Distributed Environment Proc. Int'l Conf. Knowledge Based Computer Systems (KBCS-2000), pp. 162-173, Dec. 2000.
[25] H. Kangassalo, Conceptual Level User Interfaces to Data Bases and Information Systems Advances in Information Modelling and Knowledge Bases, H. Jaakkola, H. Kangassalo, and S. Ohsuga, eds., pp. 66-90, IOS Press, 1991.
[26] M. Turk and A. Pentland, Eigenfaces for Recognition J. Cognitive Neuroscience, vol. 3, no. 1, pp. 71-86, 1991.
[27] R.G. Smith, The Contract Net Protocol: High-Level Communication and Control in a Distributed Problem Solver IEEE Trans. Computers, vol. 29, no. 12, pp. 1104-1113, Dec. 1980.
[28] A. Mahanti and A. Bagchi, AND/OR Graph Heuristic Search Methods J. ACM, vol. 32, no. 1, pp. 28-51, Jan. 1985.
[29] M.J. Swain, D.H. Ballard, Color Indexing Int'l J. Computer Vision, vol. 7, no. 1, pp. 11-32, 1991.
[30] M.S. Drew, J. Wei, and Z.N. Li, Illumination Invariant Color Object Recognition via Compressed Chromaticity Histograms of Color Channel Normalized Images Proc. Sixth Int'l Conf. Computer Vision, pp. 533-540, 1998.
[31] J. Huang, S.R. Kumar, M. Mitra, W. Zhu, and R. Zabih, Image Indexing Using Color Correlograms Proc. Computer Vision and Pattern Recognition, pp. 762-768, 1997.
[32] R.E. Neapolitan, Probabilistic Reasoning in Expert Systems: Theory and Algorithms, chapter 6, pp. 231-235. John Wiley&Sons, Inc., 1990.
[33] Document Object Model (DOM) Level 1 Specification (Version 1.0): W3C Recommendation,www.w3c.org/TR/1998REC-DOM-Level-1-19981001 , Oct. 1998.
[34] N. Fuhr, Probabilistic Models in Information Retrieval The Computer J., vol. 35, no. 3, pp. 243-255, 1992.
[35] H. Ghosh, R-MAGIC: A Cooperative Agent based Architecture for Retrieval of Multimedia Documents Distributed over Heterogeneous Repositories PhD thesis, Indian Inst. of Technology, Delhi, 2003.
[36] S. Park, E. Durfee, and W. Birmingham, Emergent Properties of a Market Based Digital Library with Strategic Agents J. Autonomous Agents and Multi-Agent Systems, vol. 3, no. 1, pp. 33-51, 2000.
Index Terms:
Reactive planning, distributed planning, multimedia retrieval, distributed retrieval, agent-based systems.
Citation:
Hiranmay Ghosh, Santanu Chaudhury, "Distributed and Reactive Query Planning in R-MAGIC: An Agent-Based Multimedia Retrieval System," IEEE Transactions on Knowledge and Data Engineering, vol. 16, no. 9, pp. 1082-1095, Sept. 2004, doi:10.1109/TKDE.2004.40
