This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Scribble Tracker: A Matting-Based Approach for Robust Tracking
Aug. 2012 (vol. 34 no. 8)
pp. 1633-1644
Xiaohui Shen, Dept. of Electr. Eng. & Comput. Sci., Northwestern Univ., Evanston, IL, USA
Jialue Fan, Dept. of Electr. Eng. & Comput. Sci., Northwestern Univ., Evanston, IL, USA
Ying Wu, Dept. of Electr. Eng. & Comput. Sci., Northwestern Univ., Evanston, IL, USA
Model updating is a critical problem in tracking. Inaccurate extraction of the foreground and background information in model adaptation would cause the model to drift and degrade the tracking performance. The most direct yet difficult solution to the drift problem is to obtain accurate boundaries of the target. We approach such a solution by proposing a novel model adaptation framework based on the combination of matting and tracking. In our framework, coarse tracking results automatically provide sufficient and accurate scribbles for matting, which makes matting applicable in a tracking system. Meanwhile, accurate boundaries of the target can be obtained from matting results even when the target has large deformation. An effective model combining short-term features and long-term appearances is further constructed and successfully updated based on such accurate boundaries. The model can successfully handle occlusion by explicit inference. Extensive experiments show that our adaptation scheme largely avoids model drift and significantly outperforms other discriminative tracking models.

[1] S. Avidan, "Ensemble Tracking," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 2, pp. 261-271, Feb. 2007.
[2] B. Babenko, M.-H. Yang, and S. Belongie, "Visual Tracking with Online Multiple Instance Learning," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[3] X. Bai and G. Sapiro, "Geodesic Matting: A Framework for Fast Interactive Image and Video Segmentation and Matting," Int'l J. Computer Vision, vol. 82, pp. 113-132, 2009.
[4] X. Bai, J. Wang, D. Simons, and G. Sapiro, "Video Snapcut: Robust Video Object Cutout Using Localized Classifiers," Proc. ACM Siggraph, 2009.
[5] C. Bibby and I. Reid, "Robust Real-Time Visual Tracking Using Pixel-Wise Posteriors," Proc. European Conf. Computer Vision, 2008.
[6] C. Bibby and I. Reid, "Real-Time Tracking of Multiple Occluding Objects Using Level Sets," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[7] C. Bregler and J. Malik, "Tracking People with Twists and Exponential Maps," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1998.
[8] Y.-Y. Chuang, A. Agarwala, B. Curless, D.H. Salesin, and R. Szeliski, "Video Matting of Complex Scenes," Proc. ACM Siggraph, 2002.
[9] Y.-Y. Chuang, B. Curless, D.H. Salesin, and R. Szeliski, "A Bayesian Approach to Digital Matting," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001.
[10] R.T. Collins, Y. Liu, and M. Leordeanu, "On-Line Selection of Discriminative Tracking Features," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 10, pp. 1631-1643, Oct. 2005.
[11] D. Comaniciu, V. Ramesh, and P. Meer, "Real-Time Tracking of Non-Rigid Objects Using Mean Shift," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2000.
[12] S. Dambreville, Y. Rathi, and A. Tannenbaum, "A Framework for Image Segmentation Using Shape Models and Kernel Space Shape Priors," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 8, pp. 1385-1399, Aug. 2008.
[13] J. Fan, X. Shen, and Y. Wu, "Closed-Loop Adaptation for Robust Tracking," Proc. European Conf. Computer Vision, 2010.
[14] H. Grabner and H. Bischof, "On-Line Boosting and Vision," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
[15] H. Grabner, C. Leistner, and H. Bischof, "Semi-Supervised On-Line Boosting for Robust Tracking," Proc. European Conf. Computer Vision, 2008.
[16] L. Grady, "Random Walks for Image Segmentation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 11, pp. 1768-1783, Nov. 2006.
[17] G. Hager and P. Belhumeur, "Real-Time Tracking of Image Regions with Changes in Geometry and Illumination," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1996.
[18] K. He, J. Sun, and X. Tang, "Fast Matting Using Large Kernel Matting Laplacian Matrices," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[19] M. Isard and A. Blake, "Condensation—Conditional Density Propagation for Visual Tracking," Int'l J. Computer Vision, vol. 29, pp. 5-28, 1998.
[20] A. Jepson, D. Fleet, and T. El-Maraghi, "Robust Online Appearance Models for Visual Tracking," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 10, pp. 1296-1311, Oct. 2003.
[21] Z. Kalal, J. Matas, and K. Mikolajczyk, "P-n Learning: Bootstrapping Binary Classifiers from Unlabeled Data by Structural Constraints," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[22] M. Kass, A. Witkin, and D. Terzopoulos, "Snakes: Active Contour Models," Int'l J. Computer Vision, vol. 1, pp. 321-331, 1988.
[23] M. Kim, S. Kumar, V. Pavlovic, and H.A. Rowley, "Face Tracking and Recognition with Visual Constraints in Real-World Videos," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[24] P. Kohli and P.H. Torr, "Measuring Uncertainty in Graph Cut Solutions," Computer Vision and Image Understanding, vol. 112, pp. 30-38, 2008.
[25] F.P. Kuhl and C.R. Giardina, "Elliptic Fourier Features of a Closed Contour," Computer Graphics and Image Processing, vol. 18, pp. 236-258, 1982.
[26] J. Kwon and K.M. Lee, "Visual Tracking Decomposition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[27] A. Levin, D. Lischinski, and Y. Weiss, "A Closed-Form Solution to Natural Image Matting," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 2, pp. 228-242, Feb. 2008.
[28] X. Liu and T. Yu, "Gradient Feature Selection for Online Boosting," Proc. Int'l Conf. Computer Vision, 2007.
[29] D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," Int'l J. Computer Vision, vol. 60, pp. 91-110, 2004.
[30] L. Lu and G.D. Hager, "A Nonparametric Treatment on Location/Segmentation Based Visual Tracking," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[31] I. Matthews, T. Ishikawa, and S. Baker, "The Template Update Problem," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 6, pp. 810-815, June 2004.
[32] H.T. Nguyen and A.W.M. Smeulders, "Robust Tracking Using Foreground-Background Texture Discrimination," Int'l J. Computer Vision, vol. 69, pp. 277-293, 2006.
[33] M. Ozuysal, V. Lepetit, F. Fleuret, and P. Fua, "Feature Harvesting for Tracking-by-Detection," Proc. European Conf. Computer Vision, 2006.
[34] S. Pellegrini, A. Ess, K. Schindler, and L.V. Gool, "You'll Never Walk Alone: Modeling Social Behavior for Multi-Target Tracking," Proc. IEEE Int'l Conf. Computer Vision, 2009.
[35] X. Ren and J. Malik, "Tracking as Repeated Figure/Ground Segmentation," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[36] D. Ross, J. Lim, R.-S. Lin, and M.-H. Yang, "Incremental Learning for Robust Visual Tracking," Int'l J. Computer Vision, vol. 77, pp. 125-141, 2008.
[37] T. Schoenemann and D. Cremers, "Globally Optimal Shape-Based Tracking in Real-Time," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[38] S. Stalder, H. Grabner, and L.V. Gool, "Beyond Semi-Supervised Tracking: Tracking Should Be as Simple as Detection but Not Simpler Than Recognition," Proc. 12th IEEE Int'l Conf. Computer Vision Workshops, 2009.
[39] K. Toyama and A. Blake, "Probabilistic Tracking with Exemplars in a Metric Space," Proc. IEEE Int'l Conf. Computer Vision, 2001.
[40] J. Wang and M.F. Cohen, "Image and Video Matting: A Survey," Foundations and Trends in Computer Graphics and Vision, vol. 3, pp. 97-175, 2007.
[41] J. Wang and M.F. Cohen, "Optimized Color Sampling for Robust Matting," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[42] T. Woodley, B. Stenger, and R. Cipolla, "Tracking Using Online Feature Selection and a Local Generative Model," Proc. British Machine Vision Conf., 2007.
[43] Y. Wu and J. Fan, "Contextual Flow," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[44] M. Yang, Y. Wu, and G. Hua, "Context-Aware Visual Tracking," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 7, pp. 1195-1209, July 2009.
[45] A. Yilmaz, O. Javed, and M. Shah, "Object Tracking: A Survey," J. ACM Computing Surveys, vol. 38, pp. 13-es, 2006.
[46] Z. Yin and R. Collins, "Shape Constrained Figure-Ground Segmentation and Tracking," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[47] T. Yu and Y. Wu, "Collaborative Tracking of Multiple Targets," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004.
[48] Y. Zhou and H. Tao, "A Background Layer Model for Object Tracking through Occlusion," Proc. Int'l Conf. Computer Vision, 2003.

Index Terms:
object tracking,computer vision,image segmentation,explicit inference,scribble tracker,matting-based approach,robust tracking,model updating,occlusion,Target tracking,Color,Image color analysis,Adaptation models,Image segmentation,Labeling,video analysis.,Visual tracking,matting,model updating
Citation:
Xiaohui Shen, Jialue Fan, Ying Wu, "Scribble Tracker: A Matting-Based Approach for Robust Tracking," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, no. 8, pp. 1633-1644, Aug. 2012, doi:10.1109/TPAMI.2011.257
Usage of this product signifies your acceptance of the Terms of Use.