This Article 
 Bibliographic References 
 Add to: 
WVTDB-A Semantic Content-Based Video Database System on the World Wide Web
November/December 1998 (vol. 10 no. 6)
pp. 947-966

Abstract—This paper describes the design and implementation of a web-based video database system (WVTDB) that demonstrates our research on video data modeling, semantic content-based video query, and video database system architecture. The video data model of WVTDB is based on multilevel video data abstractions and annotation layering, thus allowing dynamic and incremental video annotation and indexing, multiuser view sharing, and video data reuse. Users can query, retrieve, and browse video data based on their semantic content descriptions and temporal constraints on the video segments. WVTDB employs a modular system architecture that supports distributed video query processing and subquery caching. Several techniques, such as video wrappers and lazy delivery, are also proposed specifically to address the network bandwidth limitations for this kind of web-based system. We also address adaptivity, data access control, and user profile issues.

[1] J.F. Allen, “Maintaining Knowledge about Temporal Intervals,” Comm. ACM, vol. 26, no. 11, pp. 832–843, 1983.
[2] E. Ardizzone and M. La Casia, “Automatic Video Database Indexing and Retrieval,” Multimedia Tools and Applications, vol. 4, no. 1, pp. 29-56, 1997.
[3] J.S. Boreczky and L.A. Rowe, "A Comparison of Video Shot Boundary Detection Techniques," J. Electronic Imaging, vol. 5, no. 2, pp. 122-128, Apr. 1996.
[4] C.M. Bowman, P.B. Danzig, and D.R. Hardy, "Harvest: A Scalable, Customizable Discovery and Access System," Technical Report CU-CS-732-94, Dept. of Computer Science, Univ. of Colorado-Boulder, 1995.
[5] "Frequently Asked Questions About Closed Captioning," .
[6] C.W. Chang, K.F. Lin, and S.Y. Lee, "The Characteristics of Digital Video and Considerations of Designing Video Databases," Proc. Fourth Int'l Conf. Information and Knowledge Management,Baltimore, Md., pp. 370-377, Nov. 1995.
[7] A. Dan, D. Sitaram, and J. Song, "BRAHMA: Browsing and Retrieval Architecture for Hierarchical Multimedia Annotation," Proc. Second Multimedia Information Systems Workshop,West Point, N.Y., pp. 25-29, 1996.
[8] G. Davenport, T.G.A. Smith, and N. Pincever, "Cinematic Primitives for Multimedia," IEEE Computer Graphics&Applications, pp. 67-74, July 1991.
[9] Y.F. Day, S. Dagtas, M. Iino, A. Khokhar, and A. Ghafoor, “Object-Oriented Conceptual Modeling of Video Data,” Proc. Data Eng. (DE '95), pp. 401-408, 1995.
[10] A.K. Elmagarmid, H. Jiang et al., , Video Database System: Issues, Products and Applications, Kluwer, 1997.
[11] M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker, “Query by Image and Video Content: The QBIC System,” IEEE Computer, 1995.
[12] D. Le Gall, “MPEG: A Video Compression Standard for Multimedia Applications,” Comm. ACM, Apr. 1991.
[13] A. Hampapur, "Design Video Data Management Systems," PhD thesis, Univ. of Michigan, Ann Arbor, 1995.
[14] R. Hjelsvold and R. Midstraum, “Modeling and Querying Video Data,” Proc. 20th Very Large Data Bases Conf., pp. 686-694, 1994.
[15] M. Ioka and M. Kurokawa, "Estimation of Notion Vectors and Their Application to Scene Retrieval," Technical Report 1623-14, IBM Research, Tokyo Research Lab, Japan, 1993.
[16] H. Jiang and A.K. Elmagarmid, "Extracting Visual Content Representation of Video Data in Video Databases," Proc. Int'l Conf. Imaging Science, Systems, and Technology, 1997.
[17] H. Jiang, A. Helal, A.K. Elmagarmid, and A. Joshi, "Scene Change Detection Techniques for Video Database Systems," ACM Multimedia Systems, vol. 6, no. 3, pp. 186-195, May 1998.
[18] H. Jiang, D. Montesi, and A.K. Elmagarmid, "VideoText Database Systems," Proc. Fourth IEEE Int'l Conf. Multimedia Computing and Systems, pp. 344-351, 1997.
[19] H. Jiang and G. Vanecek, "N-body Collision Detection Based on Lazy Evaluation," Proc. First Workshop Simulation and Interaction in Virtual Environments, Univ. of Iowa, July 1995.
[20] F. Kokkoras, H. Jiang, I. Valhavas, A.K. Elmagarmid, and E.N. Houstis, "Smart VideoText: An Intelligent Video Database System," Technical Report 97-049, Computer Science Dept., Purdue Univ., West Lafayette, Ind., Oct. 1997.
[21] J.C.-M. Lee, Q. Li, and W. Xiong, "VIMS: A Video Information Management System," Multimedia Tools and Applications, vol. 4, pp. 7-28, 1997.
[22] Z. Lei and Y.-T. Lin, "3D Shape Inferencing and Modeling for Semantic Video Retrieval," Proc. Multimedia Storage and Archiving Systems, C.-C. Jay Kuo, ed., Boston, vol. 2916, pp. 224-235, Nov. 1996.
[23] T.D.C. Little, G. Ahanger, R.J. Folz, J.F. Gibbon, F.W. Reeve, D.H. Schelleng, and D. Venkatesh, “A Digital On-Demand Video Service Supporting Content-based Queries,” Proc. ACM Multimedia Conf., pp. 427-436, Aug. 1993.
[24] U. Manber and S. Wu, "Glimpse: A Tool to Search Through Entire File System," Technical Report. TR 93-34, Univ. of Arizona, Tucson, Oct. 1993.
[25] Sun Microsystems, "Java Compiler Compiler (JavaCC)—The Java Parser Generator," , 1998.
[26] Sun Microsystems, "Java Media Framework API," jmf/, 1998.
[27] R. Mohan, "Text-Based Search of TV News Stories," Proc. SPIE Multimedia Storage and Archiving Systems, C.-C. Jay Kuo, ed., Boston, vol. 2,916, Nov. 1996.
[28] E. Oomoto, “Design and Implementation of a Video-Object Database System,” IEEE Trans. Knowledge and Data Eng., vol. 5, no. 4, pp. 629-643, Aug. 1993.
[29] L. Qiao and K. Nahrstedt, "Comparison of MPEG Encryption Algorithms," Int'l J. Computers&Graphics, vol. 22, no. 3, special section on data security in image communication and network, 1998.
[30] R. Ramakrishnan, Database Management Systems, McGraw-Hill, 1997.
[31] R.A. Rowe, J.S. Boreczky, and C.A. Eads, "Indexes for User Access to Large Video Databases," Storage and Retrieval for Image and Video Databases II, Proc. Symp. Electrical Imaging Science and Technology, Feb. 1994.
[32] T.G.A. Smith and G. Davenport, "The Stratification System: A Design Environment for Random Access Video," Proc. Workshop Networking and Operating System Support for Digital Audio and Video, 1992.
[33] L. Teodosio and W. Bender, "Salient Video Stills: Content and Context Preserved," Proc. ACM Multimedia 93, ACM Press, New York, 1993, pp. 39-46.
[34] L. Wall, T. Christiansen, and R.L. Schwartz, Programming in Perl, O'Reilly and Associates, second ed., 1996.
[35] R. Weiss, A. Duda, and D.K. Gifford, “Content-Based Access to Algebraic Video,” Proc. Int'l Conf. Multimedia Computing and Systems, pp. 140-151, May 1994.
[36] M.M. Yeung, B-L Yeo, and B. Liu, "Extracting Story Units from Long Programs for Video Browsing and Navigation," Proc. Third IEEE Int'l Conf. Multimedia Computing and Systems, June 1996.
[37] A. Yoshitaka, M. Yoshimitsu, and M. Hirakawa, "V-QBE: Video Database Retrieval by Means of Example Motion of Objects," Proc. Third IEEE Int'l Conf. Multimedia Computing and Systems, pp. 453-457, 1996.

Index Terms:
Video database, video query, video retrieval, video indexing, video browsing, video representation, query cache, World Wide Web, access control.
Haitao Jiang, Ahmed K. Elmagarmid, "WVTDB-A Semantic Content-Based Video Database System on the World Wide Web," IEEE Transactions on Knowledge and Data Engineering, vol. 10, no. 6, pp. 947-966, Nov.-Dec. 1998, doi:10.1109/69.738359
Usage of this product signifies your acceptance of the Terms of Use.