The Community for Technology Leaders
Green Image
Issue No. 03 - March (2011 vol. 33)
ISSN: 0162-8828
pp: 603-617
Hujun Bao , Zhejiang University, Hangzhou
Wei Hua , Zhejiang University, Hangzhou
Jiaya Jia , The Chinese University of Hong Kong, Hong Kong
Guofeng Zhang , Zhejiang University, Hangzhou
ABSTRACT
Extracting high-quality dynamic foreground layers from a video sequence is a challenging problem due to the coupling of color, motion, and occlusion. Many approaches assume that the background scene is static or undergoes the planar perspective transformation. In this paper, we relax these restrictions and present a comprehensive system for accurately computing object motion, layer, and depth information. A novel algorithm that combines different clues to extract the foreground layer is proposed, where a voting-like scheme robust to outliers is employed in optimization. The system is capable of handling difficult examples in which the background is nonplanar and the camera freely moves during video capturing. Our work finds several applications, such as high-quality view interpolation and video editing.
INDEX TERMS
Bilayer segmentation, depth recovery, motion estimation, video editing.
CITATION
Hujun Bao, Wei Hua, Jiaya Jia, Guofeng Zhang, "Robust Bilayer Segmentation and Motion/Depth Estimation with a Handheld Camera", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 33, no. , pp. 603-617, March 2011, doi:10.1109/TPAMI.2010.115
115 ms
(Ver )