loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
2003 IEEE/WIC International Conference on Web Intelligence (WI'03)
Video Browsing and Retrieval Based on Multimodal Integration
Halifax, Canada
October 13-October 17
ISBN: 0-7695-1932-6
Yingying Zhu, Wuhan University
Dongru Zhou, Wuhan University
The rapid growth of multimedia data requires more effective content-based video browsing and retrieval. In this paper, we present a system developed for video browsing and retrieval based on multimedia integration. First, a basic structure of the system is defined. Second, a robust scene segmentation method is presented, which analyzes audio and visual information and accounts for their inter-relations and coincidence to semantically identify video scenes. We then extract text from key frames with video OCR technique and extract text transcriptions by speech recognition to classify video scenes and form the full-text indices. Finally, natural language understanding technique is used to automatically classify video scenes on the basis of the texts obtained from close caption, video OCR process and speech recognition. In this way, we have developed the content-based video database system which integrates multimodality to browse and retrieve video data. The experimental results show that multimodal integration is effective for video scene segmentation. Our system built on the idea of multimodal integration makes content-based browsing and retrieval of video data, key-frame-based video abstract and search by keywords practical.
Citation:
Yingying Zhu, Dongru Zhou, "Video Browsing and Retrieval Based on Multimodal Integration," wi, pp.650, 2003 IEEE/WIC International Conference on Web Intelligence (WI'03), 2003
Usage of this product signifies your acceptance of the Terms of Use.