The Community for Technology Leaders
Green Image
Issue No. 08 - Aug. (2013 vol. 19)
ISSN: 1077-2626
pp: 1354-1361
Feng Liu , Dept. of Comput. Sci., Portland State Univ., Portland, OR, USA
Tong-Yee Lee , Dept. of Comput. Sci. & Inf. Eng., Nat. Cheng-Kung Univ., Tainan, Taiwan
Pu-Sheng Hsu , Dept. of Comput. Sci. & Inf. Eng., Nat. Cheng-Kung Univ., Tainan, Taiwan
Yu-Shuen Wang , Dept. of Comput. Sci., Nat. Chiao-Tung Univ., Hsinchu, Taiwan
Properly handling parallax is important for video stabilization. Existing methods that achieve the aim require either 3D reconstruction or long feature trajectories to enforce the subspace or epipolar geometry constraints. In this paper, we present a robust and efficient technique that works on general videos. It achieves high-quality camera motion on videos where 3D reconstruction is difficult or long feature trajectories are not available. We represent each trajectory as a Bézier curve and maintain the spatial relations between trajectories by preserving the original offsets of neighboring curves. Our technique formulates stabilization as a spatial-temporal optimization problem that finds smooth feature trajectories and avoids visual distortion. The Bézier representation enables strong smoothness of each feature trajectory and reduces the number of variables in the optimization problem. We also stabilize videos in a streaming fashion to achieve scalability. The experiments show that our technique achieves high-quality camera motion on a variety of challenging videos that are difficult for existing methods.
Trajectory, Streaming media, Cameras, Optimization, Smoothing methods, Robustness, Image reconstruction, Bézier curve, Video stabilization, warping, optimization
Feng Liu, Tong-Yee Lee, Pu-Sheng Hsu, Yu-Shuen Wang, "Spatially and Temporally Optimized Video Stabilization", IEEE Transactions on Visualization & Computer Graphics, vol. 19, no. , pp. 1354-1361, Aug. 2013, doi:10.1109/TVCG.2013.11
95 ms
(Ver 3.1 (10032016))