Issue No. 09 - Sept. (2014 vol. 20)
Yongwei Nie , Computer School of Wuhan University, Wuhan, China
Hanqiu Sun , Department of Computer Science & Engineering, The Chinese University of Hong Kong, Shatin, Hong Kong
Ping Li , Department of Mathematics and Information Technology, the Hong Kong Institute of Education, Tai Po, Hong Kong
Chunxia Xiao , Computer School of Wuhan University, Wuhan, China
Kwan-Liu Ma , Department of Computer Science , University of California-Davis,
Video synopsis aims at removing video’s less important information, while preserving its key content for fast browsing, retrieving, or efficient storing. Previous video synopsis methods, including frame-based and object-based approaches that remove valueless whole frames or combine objects from time shots, cannot handle videos with redundancies existing in the movements of video object. In this paper, we present a novel part-based object movements synopsis method, which can effectively compress the redundant information of a moving video object and represent the synopsized object seamlessly. Our method works by part-based assembling and stitching. The object movement sequence is first divided into several part movement sequences. Then, we optimally assemble moving parts from different part sequences together to produce an initial synopsis result. The optimal assembling is formulated as a part movement assignment problem on a Markov Random Field (MRF), which guarantees the most important moving parts are selected while preserving both the spatial compatibility between assembled parts and the chronological order of parts. Finally, we present a non-linear spatiotemporal optimization formulation to stitch the assembled parts seamlessly, and achieve the final compact video object synopsis. The experiments on a variety of input video objects have demonstrated the effectiveness of the presented synopsis method.
Redundancy, Optimization, Three-dimensional displays, Electronic mail, Torso, Indexes, Educational institutions
Y. Nie, H. Sun, P. Li, C. Xiao and K. Ma, "Object Movements Synopsis viaPart Assembling and Stitching," in IEEE Transactions on Visualization & Computer Graphics, vol. 20, no. 9, pp. 1303-1315, 2014.