Issue No. 12 - December (2010 vol. 32)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TPAMI.2010.31
David Liu , Siemens Corporate Research, Princeton
Gang Hua , Nokia Research Center Hollywood, Santa Monica
Tsuhan Chen , Cornell University, Ithaca
We propose a novel method for removing irrelevant frames from a video given user-provided frame-level labeling for a very small number of frames. We first hypothesize a number of windows which possibly contain the object of interest, and then determine which window(s) truly contain the object of interest. Our method enjoys several favorable properties. First, compared to approaches where a single descriptor is used to describe a whole frame, each window's feature descriptor has the chance of genuinely describing the object of interest; hence it is less affected by background clutter. Second, by considering the temporal continuity of a video instead of treating frames as independent, we can hypothesize the location of the windows more accurately. Third, by infusing prior knowledge into the patch-level model, we can precisely follow the trajectory of the object of interest. This allows us to largely reduce the number of windows and hence reduce the chance of overfitting the data during learning. We demonstrate the effectiveness of the method by comparing it to several other semi-supervised learning approaches on challenging video clips.
Topic model, probabilistic graphical model, Multiple Instance Learning, semi-supervised learning, object detection, video object summarization.
David Liu, Gang Hua, Tsuhan Chen, "A Hierarchical Visual Model for Video Object Summarization", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 32, no. , pp. 2178-2190, December 2010, doi:10.1109/TPAMI.2010.31