This Article 
 Bibliographic References 
 Add to: 
A Query Model to Synthesize Answer Intervals from Indexed Video Units
September/October 2001 (vol. 13 no. 5)
pp. 824-838

Abstract—While a query result in a traditional database is a subset of the database, in a video database, it is a set of subintervals extracted from the raw video sequence. It is very hard, if not impossible, to predetermine all the queries that will be issued in the future, and all the subintervals that will become necessary to answer them. As a result, conventional query frameworks are not applicable to video databases. In this paper, we propose a new video query model that computes query results by dynamically synthesizing needed subintervals from fragmentary indexed intervals in the database. We introduce new interval operations required for that computation. We also propose methods to compute relative relevance of synthesized intervals to a given query. A query result is a list of synthesized intervals sorted in the order of their degree of relevance.

[1] J.F. Allen, “Maintaining Knowledge about Temporal Intervals,” Comm. ACM, vol. 26, no. 11, pp. 832–843, 1983.
[2] P. Buneman, S. Davidson, and A. Watters, “A Semantics for Complex Objects and Approximate Queries,” J. Computer and System Sciences, vol. 43, no. 1, pp. 170-218, Aug. 1991.
[3] A.K. Elmagarmid, H. Jiang et al., , Video Database System: Issues, Products and Applications, Kluwer, 1997.
[4] C. Faloutsos and K.I. Lin, “Fastmap: A Fast Algorithm for Indexing, Data-Mining and Visualization of Traditional and Multimedia Datasets,” Proc. SIGMOD, Int'l Conf. Management of Data, pp. 163-174, 1995.
[5] M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker, “Query by Image and Video Content: The QBIC System,” IEEE Computer, 1995.
[6] A. Hauptmann and M.A. Smith, “Text and Speech and Vision for Video Segmentation: The Informedia Project,” Proc. AAAI Fall 1995 Symp. Computational Models for Integrating Language and Vision, 1995, http:/
[7] R. Hjelsvold, R. Midtstraum, and O. Sandst, “A Temporal Foundation of Video Databases,” Proc. Int'l Workshop Temporal Databases, 1995.
[8] R. Hjelsvold, R. Midtstraum, and O. Sandst, “Searching and Browsing a Shared Video Database,” Multimedia Database Systems. Design and Implementation Strategies. chapter 4, Kluwer Academic, 1996.
[9] E.J. Hwang and V.S. Subrahmanian, “Querying Video Libraries,” J. Visual Comm. and Image Representation,” vol. 7, no. 1, pp. 44-60, Mar. 1996.
[10] W. Li, K.S. Candan, K. Hirata, and Y. Hara, “A Hybrid Approach to Multimedia Database Systems through Integration of Semantics and Media-based Search,” Worldwide Computing and Its Applications, vol. 127, no. 4, pp. 182-197, Aug. 1997.
[11] L. Libkin, “Aspects of Partial Information in Databases,” PhD thesis, Univ. of Pennsylvania, 1994.
[12] W. Lipski,“On semantic issue connected with incomplete information systems,” ACM Trans. Database Systems, vol. 4, no. 3, pp. 262-296, 1979.
[13] T.D.C. Little, G. Ahanger, R.J. Folz, J.F. Gibbon, F.W. Reeve, D.H. Schelleng, and D. Venkatesh, “A Digital On-Demand Video Service Supporting Content-based Queries,” Proc. ACM Multimedia Conf., pp. 427-436, Aug. 1993.
[14] T.D.C. Little and A. Ghafoor, “Interval-Based Conceptual Models for Time-Dependent Multimedia Data,” IEEE Trans. Knowledge and Data Eng., vol. 5, no. 4, pp. 551-563, Aug. 1993.
[15] N.A. Lorentzos and Y.G. Mitsopoulos, “SQL Extension for Intervals Data,” Trans. Knowledge and Data Eng., vol. 9, no. 3, pp 480-499, May/June 1997.
[16] J.M. Morrissey,“Imprecise information and uncertainty in information systems,” ACM Trans. Information Systems, vol. 8, no. 2, pp. 159-180, 1990.
[17] D.A. Narasimhalu, M.S. Kankanhalli, and J. Wu, “Benchmarking Multimedia Databases,” Multimedia Tools and Applications, vol. 4, no. 3, pp. 333-355, 1997.
[18] E. Oomoto, “Design and Implementation of a Video-Object Database System,” IEEE Trans. Knowledge and Data Eng., vol. 5, no. 4, pp. 629-643, Aug. 1993.
[19] S. Pradhan, K. Tajima, and K. Tanaka, “Using Prototype Objects and Powerdomains to Support Public Authoring of Video Databases,” Proc. Int'l Symp. Cooperative Database Systems for Advanced Applications, pp. 210-217, 1996.
[20] S. Pradhan, K. Tajima, and K. Tanaka, “Querying Video Databases Based on Description Substantiality and Approximations,” Proc. IPSJ Int'l Symp. Information Systems and Technologies for Network Society, pp. 183-190, 1997.
[21] S. Pradhan, K. Tajima, and K. Tanaka, “A New Algebraic Approach to Retrieve Meaningful Video Intervals from Fragmentarily Indexed Video Shots,” Advances in Visual Information Management: Visual Database Systems 5 (VDB5). pp. 11-30, Kluwer Academic, May 2000.
[22] B. Simonnot and M. Smail, “Model for Interactive Retrieval of Videos and Still Images,” Multimedia Database Systems. Design and Implementation Strategies, chapter 10, Kluwer Academic Publishers, 1996.
[23] T.G.A. Smith and G. Davenport, "The Stratification System: A Design Environment for Random Access Video," Proc. Workshop Networking and Operating System Support for Digital Audio and Video, 1992.
[24] D. Swanberg, C. Shu, and R. Jain, “Architecture of Multimedia Information System for Content-Based Retrieval,” Audio Video Workshop, Nov. 1992.
[25] S.V. Vrbsky and J.W.S. Liu, “An Object-Oriented Query Processor that Produces Monotonically Improving Approximate Answers,” Proc. Seventh IEEE Conf. Data Eng., pp. 472-481, Apr. 1991.
[26] H. Wactlar, T. Kanade, M.A. Smith, and S.M. Stevens, “Intelligent Access to Digital Video: The Informedia Project,” Computer, vol. 29, no. 5, pp. 46-52, 1996.
[27] R. Weiss, A. Duda, and D.K. Gifford, "Composition and Search with a Video Algebra," IEEE MultiMedia, vol. 2, no. 1, Spring 1995, pp. 12-25.
[28] M.M. Yeung, B-L Yeo, and B. Liu, "Extracting Story Units from Long Programs for Video Browsing and Navigation," Proc. Third IEEE Int'l Conf. Multimedia Computing and Systems, June 1996.
[29] H.J. Zhang, C.Y. Low, S.W. Smoliar, and J.H. Wu, “Video Parsing, Retrieval and Browsing: An Integrated and Content-Based Solution,” Proc. ACM Multimedia, pp. 15–24, Nov. 1995.

Index Terms:
Video database, video retrieval, continuous data, indexing units, interval query, interval operations.
Sujeet Pradhan, Keishi Tajima, Katsumi Tanaka, "A Query Model to Synthesize Answer Intervals from Indexed Video Units," IEEE Transactions on Knowledge and Data Engineering, vol. 13, no. 5, pp. 824-838, Sept.-Oct. 2001, doi:10.1109/69.956104
Usage of this product signifies your acceptance of the Terms of Use.