CSDL Home IEEE Transactions on Pattern Analysis & Machine Intelligence 2011 vol.33 Issue No.11 - November
Issue No.11 - November (2011 vol.33)
Hai Ting Lin , National University of Singapore, Singapore
Yu-Wing Tai , Korean Advanced Institute of Science and Technology, Daejeon
Michael S. Brown , National University of Singapore, Singapore
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TPAMI.2011.93
This paper addresses the problem of matting motion blurred objects from a single image. Existing single image matting methods are designed to extract static objects that have fractional pixel occupancy. This arises because the physical scene object has a finer resolution than the discrete image pixel and therefore only occupies a fraction of the pixel. For a motion blurred object, however, fractional pixel occupancy is attributed to the object's motion over the exposure period. While conventional matting techniques can be used to matte motion blurred objects, they are not formulated in a manner that considers the object's motion and tend to work only when the object is on a homogeneous background. We show how to obtain better alpha mattes by introducing a regularization term in the matting formulation to account for the object's motion. In addition, we outline a method for estimating local object motion based on local gradient statistics from the original image. For the sake of completeness, we also discuss how user markup can be used to denote the local direction in lieu of motion estimation. Improvements to alpha mattes computed with our regularization are demonstrated on a variety of examples.
Matting, regularization, motion direction estimation, motion blur.
Hai Ting Lin, Yu-Wing Tai, Michael S. Brown, "Motion Regularization for Matting Motion Blurred Objects", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.33, no. 11, pp. 2329-2336, November 2011, doi:10.1109/TPAMI.2011.93