Issue No.12 - Dec. (2011 vol.17)
Matthew L. Parry , Swansea University
Philip A. Legg , Swansea University
David H.S. Chung , Swansea University
Iwan W. Griffiths , Swansea University
Min Chen , Swansea University
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TVCG.2011.208
Video storyboard, which is a form of video visualization, summarizes the major events in a video using illustrative visualization. There are three main technical challenges in creating a video storyboard, (a) event classification, (b) event selection and (c) event illustration. Among these challenges, (a) is highly application-dependent and requires a significant amount of application specific semantics to be encoded in a system or manually specified by users. This paper focuses on challenges (b) and (c). In particular, we present a framework for hierarchical event representation, and an importance-based selection algorithm for supporting the creation of a video storyboard from a video. We consider the storyboard to be an event summarization for the whole video, whilst each individual illustration on the board is also an event summarization but for a smaller time window. We utilized a 3D visualization template for depicting and annotating events in illustrations. To demonstrate the concepts and algorithms developed, we use Snooker video visualization as a case study, because it has a concrete and agreeable set of semantic definitions for events and can make use of existing techniques of event detection and 3D reconstruction in a reliable manner. Nevertheless, most of our concepts and algorithms developed for challenges (b) and (c) can be applied to other application areas.
Multimedia visualization, Time series data, Illustrative visualization.
Matthew L. Parry, Philip A. Legg, David H.S. Chung, Iwan W. Griffiths, Min Chen, "Hierarchical Event Selection for Video Storyboards with a Case Study on Snooker Video Visualization", IEEE Transactions on Visualization & Computer Graphics, vol.17, no. 12, pp. 1747-1756, Dec. 2011, doi:10.1109/TVCG.2011.208