The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.11 - November (2011 vol.33)
pp: 2329-2336
Hai Ting Lin , National University of Singapore, Singapore
Yu-Wing Tai , Korean Advanced Institute of Science and Technology, Daejeon
Michael S. Brown , National University of Singapore, Singapore
ABSTRACT
This paper addresses the problem of matting motion blurred objects from a single image. Existing single image matting methods are designed to extract static objects that have fractional pixel occupancy. This arises because the physical scene object has a finer resolution than the discrete image pixel and therefore only occupies a fraction of the pixel. For a motion blurred object, however, fractional pixel occupancy is attributed to the object's motion over the exposure period. While conventional matting techniques can be used to matte motion blurred objects, they are not formulated in a manner that considers the object's motion and tend to work only when the object is on a homogeneous background. We show how to obtain better alpha mattes by introducing a regularization term in the matting formulation to account for the object's motion. In addition, we outline a method for estimating local object motion based on local gradient statistics from the original image. For the sake of completeness, we also discuss how user markup can be used to denote the local direction in lieu of motion estimation. Improvements to alpha mattes computed with our regularization are demonstrated on a variety of examples.
INDEX TERMS
Matting, regularization, motion direction estimation, motion blur.
CITATION
Hai Ting Lin, Yu-Wing Tai, Michael S. Brown, "Motion Regularization for Matting Motion Blurred Objects", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.33, no. 11, pp. 2329-2336, November 2011, doi:10.1109/TPAMI.2011.93
REFERENCES
[1] Y. Chuang, B. Curless, D.H. Salesin, and R. Szeliski, "A Bayesian Approach to Digital Matting," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2001.
[2] A. Levin, D. Lischinski, and Y. Weiss, "A Closed-Form Solution to Natural Image Matting," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2006.
[3] A. Levin, Y. Weiss, F. Durand, and W. Freeman, "Understanding and Evaluating Blind Deconvolution Algorithms," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[4] S. Dai and Y. Wu, "Motion from Blur," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[5] J. Wang and M. Cohen, "Optimized Color Sampling for Robust Matting," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[6] J. Wang and M. Cohen, "Image and Video Matting: A Survey," Foundations and Trends in Computer Graphics and Vision, vol. 3, no. 2, pp. 97-175, 2007.
[7] J. Sun, J. Jia, C. Tang, and H. Shum, "Poisson Matting," Proc. ACM SIGGRAPH, 2004.
[8] J. Wang, M. Agrawala, and M. Cohen, "Soft Scissors: An Interactive Tool for Realtime High Quality Matting," Proc. ACM SIGGRAPH, 2007.
[9] C. Rhemann, C. Rother, P. Kohli, and M. Gelautz, "A Spatially Varying PSF-Based Prior for Alpha Matting," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[10] M. McGuire, W. Matusik, H. Pfister, J.F. Hughes, and F. Durand, "Defocus Video Matting," Proc. ACM SIGGRAPH, 2005.
[11] N. Joshi, W. Matusik, and S. Avidan, "Natural Video Matting Using Camera Arrays," Proc. ACM SIGGRAPH, 2006.
[12] J. Sun, Y. Li, S. Kang, and H. Shum, "Flash Matting," Proc. ACM SIGGRAPH, 2006.
[13] A. Agrawal and Y. Xu, "Coded Exposure Deblurring: Optimized Codes for PSF Estimation and Invertibility," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[14] M. Ben-Ezra and S. Nayar, "Motion-Based Motion Deblurring," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 6, pp. 689-698, June 2004.
[15] Y.-W. Tai, H. Du, M.S. Brown, and S. Lin, "Image/Video Deblurring Using a Hybrid Camera," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[16] Y.-W. Tai, N. Kong, S. Lin, and S.Y. Shin, "Coded Exposure Imaging for Projective Motion Deblurring," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[17] Y.-W. Tai, H. Du, M.S. Brown, and S. Lin, "Correction of Spatially Varying Image and Video Motion Blur Using a Hybrid Camera," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 6, pp. 1012-1028, June 2010.
[18] Y.-W. Tai, P. Tan, and M.S. Brown, "Richardson-Lucy Deblurring for Scenes under Projective Motion Path," accepted.
[19] J. Jia, "Single Image Motion Deblurring Using Transparency," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[20] Q. Shan, W. Xiong, and J. Jia, "Rotational Motion Deblurring of a Rigid Object from a Single Image," Proc. IEEE Int'l Conf. Computer Vision, 2007.
[21] V. Caglioti and A. Giusti, "On the Apparent Transparency of a Motion Blurred Objects," Int'l J. Computer Vision, vol. 86, nos. 2/3, pp. 243 - 255, Jan. 2010.
[22] A. Levin, "Blind Motion Deblurring Using Image Statistics," Proc. Neural Information Processing Systems, pp. 841-848, 2006.
[23] R. Liu, Z. Li, and J. Jia, "Image Partial Blur Detection and Classification," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
29 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool