This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Exploring Defocus Matting: Nonparametric Acceleration, Super-Resolution, and Off-Center Matting
March/April 2007 (vol. 27 no. 2)
pp. 43-52
Neel Joshi, University of California, San Diego
Shai Avidan, Mitsubishi Electric Research Labs
Hanspeter Pfister, Mitsubishi Electric Research Labs
William T. Freeman, Massachusetts Institute of Technology
Defocus matting is a fully automatic and passive method for pulling mattes from video captured with coaxial cameras that have different depths of field and planes of focus. Nonparametric sampling can accelerate the video-matting process from minutes to seconds per frame. In addition, a super-resolution technique efficiently bridges the gap between mattes from high-resolution video cameras and those from low-resolution cameras. Off-center matting pulls mattes for an external high-resolution camera that doesn't share the same center of projection as the low-resolution cameras used to capture the defocus matting data.

1. N. Joshi, W. Matusik, and S. Avidan, "Natural Video Matting Using Camera Arrays," ACM Trans. Graphics, vol. 25, no. 3, July 2006, pp. 779–786.
2. M. McGuire et al., "Defocus Video Matting," ACM Trans. Graphics, vol. 24, no. 3, Aug. 2005, pp. 567–576.
3. A. Hertzmann et al., "Image Analogies," Proc. Computer Graphics (Siggraph), ACM Press, 2001, pp. 327–340.
4. B.S. Reddy and B.N. Chatterji, "An FFT-based Technique for Translation, Rotation, and Scale-Invariant Image Registration," IEEE Trans. Image Processing, vol. 5, no. 8, 1996, pp. 1266–1271.
5. P. Kornprobst, R. Deriche, and G. Aubert, "Nonlinear Operators in Image Restoration," Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition (CVPR), IEEE CS Press, 1997, pp. 325–330.
6. H.S. Sawhney et al., "Hybrid Stereo Camera: An IBR Approach for Synthesis of Very High Resolution Stereoscopic Image Sequences," Siggraph: Proc. 28th Ann. Conf. Computer Graphics and Interactive Techniques, ACM Press, 2001 pp. 451–460.
7. A. Shashua and S. Avidan, "The Rank-4 Constraint in Multiple View Geometry," Proc. European Conf. Computer Vision (ECCV), Springer-Verlag, 1996, pp. 196–206.
1. B. Wallace, "Automated Production Techniques in Cartoon Animation," master's thesis, Cornell Univ., 1982.
2. A.R. Smith and J.F. Blinn, "Blue Screen Matting," Computer Graphics, Proc. Siggraph, vol. 30, ACM Press, 1996, pp. 259–268.
3. D.E. Zongker et al., "Environment Matting and Compositing," Proc. 26th Ann. Conf. Computer Graphics and Interactive Techniques, ACM Press/Addison-Wesley, 1999, pp. 205–214.
4. M. Ruzon and C. Tomasi, "Alpha Estimation in Natural Images," Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition (CVPR), IEEE CS Press, 2000, pp. 18–25.
5. Y.-Y. Chuang et al., "A Bayesian Approach to Digital Matting," Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition (CVPR), IEEE CS Press, 2001, pp. 264–271.
6. J. Sun et al. "Poisson Matting," ACM Trans. Graphics, vol. 23, no. 3, 2004, pp. 315–321.
7. Y.-Y. Chuang et al., "Video Matting of Complex Scenes," ACM Trans. Graphics, vol. 21, no. 3, 2002, pp. 243–248.
8. K. Yasuda, T. Naemura, and H. Harashima, "Thermo-key: Human Region Segmentation from Video," IEEE Computer Graphics and Applications, vol. 24, no. 1, 2004, pp. 26–30.

Index Terms:
alpha matting and compositing, example-based rendering, image-based rendering, video processing, super-resolution
Citation:
Neel Joshi, Wojciech Matusik, Shai Avidan, Hanspeter Pfister, William T. Freeman, "Exploring Defocus Matting: Nonparametric Acceleration, Super-Resolution, and Off-Center Matting," IEEE Computer Graphics and Applications, vol. 27, no. 2, pp. 43-52, March-April 2007, doi:10.1109/MCG.2007.32
Usage of this product signifies your acceptance of the Terms of Use.