The Community for Technology Leaders
RSS Icon
Issue No.04 - April (2013 vol.35)
pp: 941-953
L. Čehovin , Fac. of Comput. & Inf. Sci., Univ. of Ljubljana, Ljubljana, Slovenia
M. Kristan , Fac. of Electr. Eng., Univ. of Ljubljana, Ljubljana, Slovenia
A. Leonardis , Centre for Comput. Neurosci. & Cognitive Robot., Univ. of Birmingham, Birmingham, UK
This paper addresses the problem of tracking objects which undergo rapid and significant appearance changes. We propose a novel coupled-layer visual model that combines the target's global and local appearance by interlacing two layers. The local layer in this model is a set of local patches that geometrically constrain the changes in the target's appearance. This layer probabilistically adapts to the target's geometric deformation, while its structure is updated by removing and adding the local patches. The addition of these patches is constrained by the global layer that probabilistically models the target's global visual properties, such as color, shape, and apparent local motion. The global visual properties are updated during tracking using the stable patches from the local layer. By this coupled constraint paradigm between the adaptation of the global and the local layer, we achieve a more robust tracking through significant appearance changes. We experimentally compare our tracker to 11 state-of-the-art trackers. The experimental results on challenging sequences confirm that our tracker outperforms the related trackers in many cases by having a smaller failure rate as well as better accuracy. Furthermore, the parameter analysis shows that our tracker is stable over a range of parameter values.
Visualization, Target tracking, Adaptation models, Robustness, Computational modeling, Shape,tracking, Image processing and computer vision
L. Čehovin, M. Kristan, A. Leonardis, "Robust Visual Tracking Using an Adaptive Coupled-Layer Visual Model", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 4, pp. 941-953, April 2013, doi:10.1109/TPAMI.2012.145
[1] G.D. Hager, M. Dewan, and C.V. Stewart, "Multiple Kernel Tracking with SSD," Proc. 16th Int'l Conf. Pattern Recognition, vol. 1, pp. 790-797, 2004.
[2] M. Kristan, J. Perš, S. Kovačič, and A. Leonardis, "A Local-Motion-Based Probabilistic Model for Visual Tracking," Pattern Recognition, vol. 42, pp. 2160-2168, 2008.
[3] P. Pérez, C. Hue, J. Vermaak, and M. Gangnet, "Color-Based Probabilistic Tracking," Proc. European Conf. Computer Vision, vol. 1, pp. 661-675, 2002.
[4] R.T. Collins, Y. Liu, and M. Leordeanu, "Online Selection of Discriminative Tracking Features," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 10, pp. 1631-1643, Oct. 2005.
[5] D.A. Ross, J. Lim, R. Lin, and M. Yang, "Incremental Learning for Robust Visual Tracking," Int'l J. Computer Vision, vol. 77, nos. 1-3, pp. 125-141, May 2008.
[6] B. Babenko, M. Yang, and S. Belongie, "Robust Object Tracking with Online Multiple Instance Learning," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 8, pp. 1619-1632, Aug. 2011.
[7] H. Grabner, M. Grabner, and H. Bischof, "Real-Time Tracking via On-Line Boosting," Proc. British Machine Vision Conf., 2006.
[8] Z. Kalal, J. Matas, and K. Mikolajczyk, "P-N Learning: Bootstrapping Binary Classifiers by Structural Constraints," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 49-56, June 2010.
[9] S. Stalder, H. Grabner, and L. van Gool, "Beyond Semi-Supervised Tracking: Tracking Should Be as Simple as Detection, but Not Simpler than Recognition," Proc. 12th IEEE Int'l Conf. Computer Vision Workshop, pp. 1409-1416, Oct. 2009.
[10] B. Stenger, T. Woodley, and R. Cipolla, "Learning to Track with Multiple Observers," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2647-2654, June 2009.
[11] J. Kwon and K.M. Lee, "Visual Tracking Decomposition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1269-1276, June 2010.
[12] V. Badrinarayanan, P. Perez, F. Le Clerc, and L. Oisel, "Probabilistic Color and Adaptive Multi-Feature Tracking with Dynamically Switched Priority Between Cues," Proc. 11th IEEE Int'l Conf. Computer Vision, pp. 1-8, 2007.
[13] B. Martinez and X. Binefa, "Piecewise Affine Kernel Tracking for Non-Planar Targets," Pattern Recognition, vol. 41, no. 12, pp. 3682-3691, 2008.
[14] V. Badrinarayanan, F. Le Clerc, L. Oisel, and P. Perez, "Geometric Layout Based Graphical Model for Multi-Part Object Tracking," Proc. Int'l Workshop Visual Surveillance, 2008.
[15] W. Chang, C. Chen, and Y. Hung, "Tracking by Parts: A Bayesian Approach with Component Collaboration," IEEE Trans. Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 39, no. 2, pp. 375-388, Apr. 2009.
[16] J.S. Kwon and K.M. Lee, "Tracking of a Non-Rigid Object via Patch-Based Dynamic Appearance Modeling and Adaptive Basin Hopping Monte Carlo Sampling," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1208-1215, 2009.
[17] Z. Yin and R. Collins, "On-the-Fly Object Modeling While Tracking," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
[18] S.S. Nejhum, J. Ho, and M. Yang, "Online Visual Tracking with Histograms and Articulating Blocks," Computer Vision Image Understanding, vol. 114, no. 8, pp. 901-914, Aug. 2010.
[19] M. Godec, P.M. Roth, and H. Bischof, "Hough-Based Tracking of Non-Rigid Objects," Proc. 13th IEEE Int'l Conf. Computer Vision, Nov. 2011.
[20] J. Hoey, "Tracking Using Flocks of Features, with Application to Assisted Handwashing," Proc. British Machine Vision Conf., 2006.
[21] M. Kölsch and M. Turk, "Fast 2D Hand Tracking with Flocks of Features and Multi-Cue Integration," Proc. IEEE Conf. Computer Vision and Pattern Recognition Workshop, p. 158, 2004.
[22] L. Čehovin, M. Kristan, and A. Leonardis, "An Adaptive Coupled-Layer Visual Model for Robust Visual Tracking," Proc. 13th IEEE Int'l Conf. Computer Vision, 2011.
[23] Z. Fan, M. Yang, and Y. Wu, "Multiple Collaborative Kernel Tracking," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 7, pp. 1268-1273, July 2007.
[24] R.Y. Rubinstein, "Optimization of Computer Simulation Models with Rare Events," European J. Operational Research, vol. 99, no. 1, pp. 89-112, May 1997.
[25] A. Blake and A. Zisserman, Visual Reconstruction. MIT Press, 1987.
[26] B.D. Lucas and T. Kanade, "An Iterative Image Registration Technique with an Application to Stereo Vision (IJCAI)," Proc. Int'l Joint Conf. Artificial Intelligence, pp. 674-679, Apr. 1981.
[27] C. Harris and M. Stephens, "A Combined Corner and Edge Detection," Proc. Alvey Vision Conf., pp. 147-151, 1988.
[28] M. Kristan, A. Leonardis, and D. Skočaj, "Multivariate Online Kernel Density Estimation with Gaussian Kernels," Pattern Recognition, vol. 44, nos. 10/11, pp. 2630-2642, Oct. 2011.
[29] R.E. Kalman, "A New Approach to Linear Filtering and Prediction Problems," Trans. Am. Soc. Mechanical Engineers, J. Basic Eng., vol. 82, pp. 34-45, 1960.
[30] X. Rong Li and V.P. Jilkov, "Survey of Maneuvering Target Tracking. Part i. Dynamic Models," IEEE Trans. Aerospace and Electronic Systems, vol. 39, no. 4, pp. 1333-1364, Oct. 2003.
[31] A. Adam, E. Rivlin, and I. Shimshoni, "Robust Fragments-Based Tracking Using the Integral Histogram," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 798-805, June 2006.
[32] Q. Wang, F. Chen, W. Xu, and M. Yang, "An Experimental Comparison of Online Object-Tracking Algorithms," SPIE: Image and Signal Processing, vol. 8138, pp. 81381A-81381A-11, 2011.
[33] Y. Bar-Shalom, X.R. Li, and T. Kirubarajan, Estimation with Applications to Tracking and Navigation, first ed. Wiley-Interscience, June 2001.
[34] D. Cai, X. He, and J. Han, "Semi-Supervised Discriminant Analysis," Proc. 11th IEEE Int'l Conf. Computer Vision, pp. 1-7, 2007.
[35] F. Porikli, O. Tuzel, and P. Meer, "Covariance Tracking Using Model Update Based on Means on Riemannian Manifolds," Mitsubishi Electric Research Laboratories, technical report, 2006.
89 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool