2005 IEEE International Conference on Multimedia and Expo
On the surplus value of semantic video analysis beyond the key frame
Amsterdam, Netherlands
July 06-July 06
ISBN: 0-7803-9331-7
C.G.M. Snoek, Informatics Inst., Amsterdam Univ., Netherlands
M. Worring, Informatics Inst., Amsterdam Univ., Netherlands
D. Koelma, Informatics Inst., Amsterdam Univ., Netherlands
Typical semantic video analysis methods aim for classification of camera shots based on extracted features from a single keyframe only. In this paper, we sketch a video analysis scenario and evaluate the benefit of analysis beyond the key frame for semantic concept detection performance. We developed detectors for a lexicon of 26 concepts, and evaluated their performance on 120 hours of video data. Results show that, on average, detection performance can increase with almost 40% when the analysis method takes more visual content into account.
Index Terms:
visual content, semantic video analysis method, video classification, feature extraction, key frame, lexicon, detection performance
Citation:
C.G.M. Snoek, M. Worring, J.-M. Geusebroek, D. Koelma, F.J. Seinstra, "On the surplus value of semantic video analysis beyond the key frame," icme, pp.4 pp., 2005 IEEE International Conference on Multimedia and Expo, 2005