The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.07 - July (2011 vol.33)
pp: 1295-1309
Dheeraj Singaraju , The Johns Hopkins University, Baltimore
René Vidal , The Johns Hopkins University, Baltimore
ABSTRACT
Image matting deals with the estimation of the alpha matte at each pixel, i.e., the contribution of the foreground and background objects to the composition of the image at that pixel. Existing methods for image matting are typically limited to estimating the alpha mattes for two image layers only. However, in several applications one is interested in editing images with multiple objects. In this work, we consider the problem of estimating the alpha mattes of multiple (n \ge 2) image layers. We show that this problem can be decomposed into n simpler subproblems of alpha matte estimation for two image layers. Moreover, we show that, by construction, the estimated alpha mattes at each pixel are constrained to sum up to 1 across the multiple image layers. A key feature of our framework is that the alpha mattes can be estimated in closed form. We further show that, due to the nature of spatial regularization used in the estimation, the final estimated alpha mattes are not constrained to take values in [0,1]. Hence, we study the optimization problem of estimating the alpha mattes for multiple image layers subject to the fact that the alpha mattes are nonnegative and sum up to 1 at each pixel. We present experiments to show that our proposed method can be used to extract mattes of multiple image layers.
INDEX TERMS
Image matting, alpha matte, multiple layers, matting Laplacian, superposition principle.
CITATION
Dheeraj Singaraju, René Vidal, "Estimation of Alpha Mattes for Multiple Image Layers", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.33, no. 7, pp. 1295-1309, July 2011, doi:10.1109/TPAMI.2010.206
REFERENCES
[1] A. Berman, A. Dadourian, and P. Vlahos, "Method for Removing from an Image the Background Surrounding a Selected Object," US Patent 6,134,346, Oct. 2000.
[2] M.A. Ruzon and C. Tomasi, "Alpha Estimation in Natural Images," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1018-1025, 2000.
[3] Y.-Y. Chuang, B. Curless, D. Salesin, and R. Szeliski, "A Bayesian Approach to Digital Matting," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 264-271, 2001.
[4] J. Sun, J. Jia, C.-K. Tang, and H.-Y. Shum, "Poisson Matting," ACM Trans. Graphics, vol. 23, no. 3, pp. 315-321, 2004.
[5] C. Rother, V. Kolmogorov, and A. Blake, "'GrabCut': Interactive Foreground Extraction Using Iterated Graph Cuts," ACM Trans. Graphics, vol. 23, no. 3, pp. 309-314, 2004.
[6] J. Wang and M. Cohen, "An Iterative Optimization Approach for Unified Image Segmentation and Matting," Proc. IEEE Int'l Conf. Computer Vision, pp. 936-943, 2005.
[7] L. Grady, T. Schiwietz, S. Aharon, and R. Westermann, "Random Walks for Interactive Alpha-Matting," Proc. Int'l Conf. Visualization, Imaging and Image Processing, pp. 423-429, Sept. 2005.
[8] Y. Guan, W. Chen, X. Liang, Z. Ding, and Q. Peng, "Easy Matting: A Stroke Based Approach for Continuous Image Matting," Proc. Eurographics '06 Conf., vol. 25, no. 3, pp. 567-576, 2006.
[9] X. Bai and G. Sapiro, "A Geodesic Framework for Fast Interactive Image and Video Segmentation and Matting," Proc. IEEE Int'l Conf. Computer Vision, 2007.
[10] Y. Zheng, C. Kambhamettu, J. Yu, T. Bauer, and K. Steiner, "Fuzzymatte: A Computationally Efficient Scheme for Interactive Matting," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[11] A. Levin, D. Lischinski, and Y. Weiss, "A Closed Form Solution to Natural Image Matting," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 2, pp. 228-242, Feb. 2008.
[12] J. Wang and M. Cohen, "Optimized Color Sampling for Robust Matting," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[13] J. Wang and M. Cohen, "Simultaneous Matting and Compositing," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[14] A. Levin, A. Rav-Acha, and D. Lischinski, "Spectral Matting," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 10, pp. 1699-1712, Oct. 2008.
[15] C. Rhemann, C. Rother, A. Rav-Acha, and T. Sharp, "High Resolution Matting via Interactive Trimap Segmentation," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[16] C. Rhemann, C. Rother, and M. Gelautz, "Improving Color Modeling for Alpha Matting," Proc. British Machine Vision Conf., 2008.
[17] D. Singaraju, C. Rother, and C. Rhemann, "New Appearance Models for Natural Image Matting," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 659-666, 2009.
[18] J. Wang and M. Cohen, "Image and Video Matting: A Survey," Foundations and Trends in Computer Graphics and Vision, vol. 3, no. 2, pp. 97-175, 2007.
[19] D. Singaraju and R. Vidal, "Interactive Image Matting for Multiple Layers," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[20] M. Bleyer, M. Gelautz, C. Rother, and C. Rhemann, "A Stereo Approach that Handles the Matting Problem via Image Warping," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 501-508, 2009.
[21] E. Hsu, T. Mertens, S. Paris, S. Avidan, and F. Durand, "Light Mixture Estimation for Spatially Varying White Balance," ACM Trans. Graphics, vol. 27, no. 3, 2008.
[22] Q. Shan, W. Xiong, and J. Jia, "Rotational Motion Deblurring of a Rigid Object from a Single Image," Proc. IEEE Int'l Conf. Computer Vision, pp. 1-8, 2007.
[23] I. Omer and M. Werman, "Color Lines: Image Specific Color Representation," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 946-953, 2004.
[24] H.W. Kuhn and A.W. Tucker, "Nonlinear Programming," Proc. Second Berkeley Symp., pp. 481-492, 1951.
[25] P. Doyle and L. Snell, Random Walks and Electric Networks, no. 22. The Math. Soc. of Am., 1984.
[26] L. Grady and A. Sinop, "Fast Approximate Random Walker Segmentation Using Eigenvector Precomputation," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2008.
[27] C. Rhemann, C. Rother, J. Wang, M. Gelautz, P. Kohli, and P. Rott, "A Perceptually Motivated Online Benchmark for Image Matting," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1826-1833, 2009.
15 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool