This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Online Selection of Discriminative Tracking Features
October 2005 (vol. 27 no. 10)
pp. 1631-1643
This paper presents an online feature selection mechanism for evaluating multiple features while tracking and adjusting the set of features used to improve tracking performance. Our hypothesis is that the features that best discriminate between object and background are also best for tracking the object. Given a set of seed features, we compute log likelihood ratios of class conditional sample densities from object and background to form a new set of candidate features tailored to the local object/background discrimination task. The two-class variance ratio is used to rank these new features according to how well they separate sample distributions of object and background pixels. This feature evaluation mechanism is embedded in a mean-shift tracking system that adaptively selects the top-ranked discriminative features for tracking. Examples are presented that demonstrate how this method adapts to changing appearances of both tracked object and scene background. We note susceptibility of the variance ratio feature selection method to distraction by spatially correlated background clutter and develop an additional approach that seeks to minimize the likelihood of distraction.

[1] Y. Bar-Shalom and T. Fortmann, Tracking and Data Association. Academic Press, 1988.
[2] C. Bishop, Neural Networks for Pattern Recognition. Clarendon Press, 1997.
[3] S. Blackman and R. Popoli, Design and Analysis of Modern Tracking Systems. Artech House, 1999.
[4] G. Bradski, “Computer Vision Face Tracking for Use in a Perceptual User Interface,” Proc. IEEE Workshop Applications of Computer Vision, pp. 214-219, 1998.
[5] Y. Cheng, “Mean-Shift, Mode Seeking, and Clustering,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 8, pp. 790-799, Aug. 1995.
[6] R. Collins, A. Lipton, H. Fujiyoshi, and T. Kanade, “Algorithms for Cooperative Multi-Sensor Surveillance,” Proc. IEEE, vol. 89, no. 10, pp. 1456-1477, Oct. 2001.
[7] D. Comaniciu, V. Ramesh, and P. Meer, “Kernel-Based Object Tracking,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 5, pp. 564-577, May 2003.
[8] T. Cootes, G. Edwards, and C. Taylor, “Active Appearance Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 681-685, June 2001.
[9] J. Davis, “Recognizing Movement Using Motion Histograms,” Technical Report No. 487, MIT, Mar. 1999.
[10] A. Elgammal, R. Duraiswami, and L. Davis, “Probabilistic Tracking in Joint Feature-Spatial Spaces,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 781-788, June 2003.
[11] W. Freeman and M. Roth, “Orientation Histograms for Hand Gesture Recognition,” Proc. IEEE Workshop Automatic Face and Gesture Recognition, June 1995.
[12] E. Hayman and J.O. Eklundh, “Probabilistic and Voting Approaches to Cue Integration for Figure-Ground Segmentation,” Proc. European Conf. Computer Vision, pp. 469-486, 2002.
[13] S. Huang, S. Kumar, M. Mitra, W. Zhu, and R. Zabih, “Spatial Color Indexing and Applications,” Int'l J. Computer Vision, vol. 35, no. 3, pp. 245-268, 1999.
[14] M. Irani and P. Anandan, “A Unified Approach to Moving Object Detection in 2D and 3D Scenes,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 6, pp. 577-589, June 1998.
[15] M. Isard and A. Blake, “CONDENSATION— Conditional Density Propagation for Visual Tracking,” Int'l J. Computer Vision, vol. 29, no. 1, pp. 5-28, 1998.
[16] D. Koller, K. Daniilidis, and H. Nagel, “Model-Based Object Tracking in Monocular Image Sequences of Road Traffic Scenes,” Int'l J. Computer Vision, vol. 10, no. 3, pp. 257-281, 1993.
[17] B. Manjunath and W. Ma, “Texture Features for Browsing and Retrieval of Image Data,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 8, pp. 837-842, Aug. 1996.
[18] Y. Liu, K. Schmidt, J. Cohn, and S. Mitra, “Facial Asymmetry Quantification for Expression Invariant Human Identification,” Computer Vision and Image Understanding, vol. 91, nos. 1/2, pp. 138-159, July 2003.
[19] Y. Liu and J. Palmer, “A Quantified Study of Facial Asymmetry in 3D Faces,” Proc. IEEE Int'l Workshop Modeling of Faces and Gestures, pp. 222-229, Oct. 2003.
[20] Y. Liu et al., “Discriminative MR Image Feature Analysis for Automatic Schizophrenia and Alzheimer's Disease Classification,” Proc. Seventh Int'l Conf. Medical Image Computing and Computer Aided Intervention, pp. 393-401, Oct. 2004.
[21] I. Matthews and S. Baker, “Active Appearance Models Revisited,” Int'l J. Computer Vision, vol. 60, no. 2, pp. 135-164, Nov. 2004.
[22] I. Matthews, T. Iashikawa, and S. Baker, “The Template Update Problem,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 6, pp. 810-815, June 2004.
[23] C. Rasmussen and G. Hager, “Joint Probabilistic Techniques for Tracking Multi-Part Objects,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 560-576, June 2001.
[24] D. Reid, “An Algorithm for Tracking Multiple Targets,” IEEE Trans. Aerospace and Electronic Systems, vol. 17, pp. 122-130, Jan. 1981.
[25] S. Smith and J. Brady, “ASSET-2: Real-Time Motion Segmentation and Shape Tracking,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 8, pp. 814-820, Aug. 1995.
[26] C. Stauffer and W.E.L. Grimson, “Learning Patterns of Activity Using Real-Time Tracking,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 747-757, Aug. 2000.
[27] H. Stern and B. Efros, “Adaptive Color Space Switching for Face Tracking in Multi-Colored Lighting Environments,” IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 249-254, May 2002.
[28] G. Toussaint, “Note on Optimal Selection of Independent Binary-Valued Features for Pattern Recognition,” IEEE Trans. Information Theory, vol. 17, no. 5, pp. 618-618, 1971.
[29] K. Toyama and Y. Wu, “Bootstrap Initialization of Nonparameteric Texture Models for Tracking,” Proc. European Conf. Computer Vision, vol. 2, pp. 119-133, 2000.
[30] B. Zarit, B. Super, and F. Quek, “Comparison of Five Color Models in Skin Pixel Classification,” Proc. Int'l Workshop Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, pp. 58-63, Sept. 1999.
[31] J. Zhang and Y. Liu, “Cervical Cancer Detection Using SVM-Based Feature Screening,” Proc. Seventh Int'l Conf. Medical Image Computing and Computer Aided Intervention, pp. 873-880, Oct. 2004.
[32] X. Zhou, R. Collins, T. Kanade, and P. Metes, “A Master-Slave System to Acquire Biometric Imagery of Humans at a Distance,” Proc. ACM SIGGM Int'l Workshop Video Surveillance, pp. 113-120, Nov. 2003.
[33] Z. Zivkovic and B. Krose, “An EM-Like Algorithm for Color Histogram Based Object Tracking,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 798-803, June 2004.

Index Terms:
Index Terms- Computer vision, tracking, time-varying imagery, feature creation, feature evaluation and selection.
Citation:
Robert T. Collins, Yanxi Liu, Marius Leordeanu, "Online Selection of Discriminative Tracking Features," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 10, pp. 1631-1643, Oct. 2005, doi:10.1109/TPAMI.2005.205
Usage of this product signifies your acceptance of the Terms of Use.