This Article 
 Bibliographic References 
 Add to: 
Video Content Management in Consumer Devices
November/December 1998 (vol. 10 no. 6)
pp. 988-995

Abstract—Methods for video content analysis are necessary for the growing amount of video information delivered to consumers today. In this paper, we present a system for video content analysis called Vitamin, which provides management of a home video library. The system presents the user with a Visual Table of Contents that provides an overview of the video content and direct access to particular points in the stored video. In this process, we apply a computationally inexpensive, simple, yet powerful mechanism for cut detection and keyframe filtering. Our initial implementation and results show that this system can perform video content extraction in real time on a low-end platform that matches a Visual Table of Contents extracted by an expert.

[1] M. Abdel-Mottaleb, N. Dimitrova, R. Desai, and J. Martino, "CONIVAS: Content-Based Image and Video Access System," Proc. ACM Multimedia, pp. 427-428,Boston, 1996.
[2] F. Arman, A. Hsu, and M.-Y. Chiu, "Image Processing on Encoded Video Sequences," Multimedia Systems, vol. 1, no. 5, pp. 211-219, 1994.
[3] J.S. Boreczky and L.A. Rowe, "Comparison of Video Shot Boundary Detection Techniques," Proc. IS&T/SPIE 1996, Storage and Retrieval for Image and Video Databases IV,San Jose, Calif., Feb. 1996.
[4] S.-F. Chang, W. Chen, H.E. Meng, H. Sundaram, and D. Zong, "VideoQ: An Automated Content Based Video Search System Using Visual Cues," Proc. ACM Multimedia, pp. 313-324,Seattle, 1994.
[5] M. Christel, T. Kanade, M. Mauldin, R. Reddy, M. Sirbu, S. Stevens, and H. Wactlar, "Informedia Digital Video Library," Comm. ACM, vol. 38, no. 4, pp. 57-58, 1995.
[6] M. Davis, "Media Streams: An Iconic Visual Language for Video Annotation," Proc. Telektronikk, vol. 89, no. 4, pp. 59-71, 1993.
[7] Y.F. Day, S. Dagstas, and A. Ghafoor, “Spatio-Temporal Modeling of Video Data for On-Line Object-Oriented Query Processing,” Proc. IEEE Int'l Conf. Multimedia (ICMCS '95), pp. 98-105, 1995.
[8] N. Dimitrova, T. McGee, and H. Elenbaas, "Video Keyframe Extraction and Filtering: A Keyframe is Not a Keyframe to Everyone," Proc. ACM Conf. Knowledge and Information Management, pp. 113-120, 1997.
[9] N. Dimitrova and M.F. Golshani, "Video and Image Content Representation and Retrieval," Proc. Handbook Multimedia Information Management, pp. 95-138, Prentice Hall, 1997.
[10] W. Grosky, "Managing Multimedia Information in Database Systems," Comm. ACM, vol. 40, no. 12, pp. 73-80, 1997.
[11] A. Gupta and R. Jain, “Visual Information Retrieval,” Comm. ACM, vol. 40, no. 5, pp. 70-79, May 1997.
[12] A. Hampapur, R. Jain, and T. Weymouth, "Digital Video Segmentation," Proc. ACM Multimedia '94, pp. 357-364,San Francisco, Oct. 1994.
[13] V. Kobla, D. Doermann, K. Lin, and C. Faloutsos, "Compressed Domain Video Indexing Techniques Using DCT and Motion Vector Information in MPEG Video," Proc. IS&T/SPIE Storage and Retrieval for Image and Video Databases V, vol. 3,022, pp. 200-211,San Jose, Calif., 1997.
[14] M. Mills, J. Cohen, and Y.Y. Wong, "A Magnifier Tool for Video Data," Proc. CHI '92,Monterey, Calif., ACM Press, pp. 93-98, 1992.
[15] W. Niblack, X. Zhu, J.L. Hafner, T. Bruel, D.B. Ponceleon, D. Petkovic, M. Flickner, E. Upfal, S.I. Nin, S. Sull, and B.E. Dom, "Updates to the QBIC System," Proc. IS&T/SPIE, Storage and Retrieval for Image and Video Databases VI, vol. 3,312, pp. 150-161,San Jose, Calif., 1998.
[16] K. Nwosu, B. Thuraisingham, and P. B. Berra, “Multimedia Database Systems-A New Frontier,” IEEE Multimedia, vol. 4, no. 3, pp. 21-23, July/Sept. 1997.
[17] S. Pfeiffer, R. Lienhart, S. Fischer, and W. Effelsberg, "Abstracting Digital Movies Automatically," J. Visual Comm. and Image Representation, vol. 7, no. 4, pp. 345-353, 1996.
[18] B. Shen and I. Sethi, "Convulsion-Based Edge Detection for Image/Video in Block DCT Domain," J. Visual Comm. and Image Representation, 1996.
[19] L. Teodosio and W. Bender, "Salient Video Stills: Content and Context Preserved," Proc. ACM Multimedia 93, ACM Press, New York, 1993, pp. 39-46.
[20] Y. Tonomura and S. Abe, "Content Oriented Visual Interface Using Video Icons for Visual Database Systems," Proc. IEEE Workshop on Visual Languages, pp. 68-37,Rome, IEEE CS Press, 1989.
[21] B. Yeo and B. Liu, "A Unified Approach to Temporal Segmentation of Motion JPEG and MPEG Compressed Video," Proc. Multimedia Tools and Applications, vol. 1, no. 1, pp. 81-88, 1995.
[22] M.M. Yeung and B. Yeo, "Video Content Characterization and Compaction for Digital Library Applications, in Storage, and Retrieval for Image and Video Databases V," Proc. SPIE 3,022, pp. 45-58, 1997.
[23] R. Zabih, J. Miller, and K. Mai, "A Feature-Based Algorithm for Detecting and Classifying Scene Breaks," Proc. ACM Multimedia, pp. 189-200,San Francisco, 1995.
[24] H. Zhang, C. Low, and S. Smoliar, "Video Parsing and Indexing of Compressed Data," Multimedia Tools and Applications, Mar. 1995, pp. 89-111.

Index Terms:
Video indexing, video segmentation, video retrieval, content-based video retrieval, video content analysis, Visual Table of Contents, video browsing.
Nevenka Dimitrova, Thomas McGee, Herman Elenbaas, Jacquelyn Martino, "Video Content Management in Consumer Devices," IEEE Transactions on Knowledge and Data Engineering, vol. 10, no. 6, pp. 988-995, Nov.-Dec. 1998, doi:10.1109/69.738361
Usage of this product signifies your acceptance of the Terms of Use.