Issue No. 07 - July (2006 vol. 28)
Y. Matsushita , Microsoft Res. Asia, Beijing
E. Ofek , Microsoft Res. Asia, Beijing
Video stabilization is an important video enhancement technology which aims at removing annoying shaky motion from videos. We propose a practical and robust approach of video stabilization that produces full-frame stabilized videos with good visual quality. While most previous methods end up with producing smaller size stabilized videos, our completion method can produce full-frame videos by naturally filling in missing image parts by locally aligning image data of neighboring frames. To achieve this, motion inpainting is proposed to enforce spatial and temporal consistency of the completion in both static and dynamic image areas. In addition, image quality in the stabilized video is enhanced with a new practical deblurring algorithm. Instead of estimating point spread functions, our method transfers and interpolates sharper image pixels of neighboring frames to increase the sharpness of the frame. The proposed video completion and deblurring methods enabled us to develop a complete video stabilizer which can naturally keep the original image quality in the stabilized videos. The effectiveness of our method is confirmed by extensive experiments over a wide variety of videos
Cameras, Pixel, Image quality, Layout, Motion estimation, Robustness, Filling, Image motion analysis, Motion analysis, Video sequences
Y. Matsushita, E. Ofek, Weina Ge, Xiaoou Tang and Heung-Yeung Shum, "Full-frame video stabilization with motion inpainting," in IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 28, no. 7, pp. 1150-1163, 2009.