This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Content-Aware Video Retargeting Using Object-Preserving Warping
Oct. 2013 (vol. 19 no. 10)
pp. 1677-1686
Shih-Syun Lin, Dept. of Comput. Sci. & Inf. Eng., Nat. Cheng Kung Univ., Tainan, Taiwan
Chao-Hung Lin, Dept. of Geomatics, Nat. Cheng Kung Univ., Tainan, Taiwan
I-Cheng Yeh, Dept. of Comput. Sci. & Eng., Yuan Ze Univ., Chungli, Taiwan
Shu-Huai Chang, Dept. of Comput. Sci. & Inf. Eng., Nat. Cheng Kung Univ., Tainan, Taiwan
Chih-Kuo Yeh, Dept. of Comput. Sci. & Inf. Eng., Nat. Cheng Kung Univ., Tainan, Taiwan
Tong-Yee Lee, Dept. of Comput. Sci. & Inf. Eng., Nat. Cheng Kung Univ., Tainan, Taiwan
A novel content-aware warping approach is introduced for video retargeting. The key to this technique is adapting videos to fit displays with various aspect ratios and sizes while preserving both visually salient content and temporal coherence. Most previous studies solve this spatiotemporal problem by consistently resizing content in frames. This strategy significantly improves the retargeting results, but does not fully consider object preservation, sometimes causing apparent distortions on visually salient objects. We propose an object-preserving warping scheme with object-based significance estimation to reduce this unpleasant distortion. In the proposed scheme, visually salient objects in 3D space-time space are forced to undergo as-rigid-as-possible warping, while low-significance contents are warped as close as possible to linear rescaling. These strategies enable our method to consistently preserve both the spatial shapes and temporal motions of visually salient objects and avoid overdeformations on low-significance objects, yielding a pleasing motion-aware video retargeting. Qualitative and quantitative analyses, including a user study and experiments on complex videos containing diverse cameras and dynamic motions, show a clear superiority of our method over related video retargeting methods.
Index Terms:
Coherence,Optimization,Shape,Weaving,Spatiotemporal phenomena,Three-dimensional displays,Motion segmentation,warping,Video retargeting,spatial and temporal coherence,optimization
Citation:
Shih-Syun Lin, Chao-Hung Lin, I-Cheng Yeh, Shu-Huai Chang, Chih-Kuo Yeh, Tong-Yee Lee, "Content-Aware Video Retargeting Using Object-Preserving Warping," IEEE Transactions on Visualization and Computer Graphics, vol. 19, no. 10, pp. 1677-1686, Oct. 2013, doi:10.1109/TVCG.2013.75
Usage of this product signifies your acceptance of the Terms of Use.