The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.04 - April (2008 vol.30)
pp: 670-685
ABSTRACT
We propose a new technique for fusing multiple cues to robustly segment an object from itsbackground in video sequences that suffer from abrupt changes of both illumination and position ofthe target. Robustness is achieved by the integration of appearance and geometric object features andby their estimation using Bayesian filters, such as Kalman or particle filters. In particular, each filterestimates the state of a specific object feature, conditionally dependent on another feature estimatedby a distinct filter. This dependence provides improved target representations, permitting to segmentit out from the background even in non-stationary sequences. Considering that the procedure of theBayesian filters may be described by a 'hypotheses generation - hypotheses correction- strategy, themajor novelty of our methodology compared to previous approaches is that the mutual dependencebetween filters is considered during the feature observation, i.e, into the 'hypotheses correction' stage,instead of considering it when generating the hypotheses. This proves to be much more effective interms of accuracy and reliability. The proposed method is analytically justified and applied to developa robust tracking system that adapts online and simultaneously the colorspace where the image pointsare represented, the color distributions, the contour of the object and its bounding box. Results withsynthetic data and real video sequences demonstrate the robustness and versatility of our method.
INDEX TERMS
Bayesian Tracking, Multiple Cue Integration
CITATION
Alberto Sanfeliu, Francesc Moreno-Noguer, "Dependent Multiple Cue Integration for Robust Tracking", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.30, no. 4, pp. 670-685, April 2008, doi:10.1109/TPAMI.2007.70727
REFERENCES
[1] Y. Bar-Shalom, X.R. Li, and T. Kirubarajan, Estimation with Applications to Tracking and Navigation. John Wiley & Sons, 2001.
[2] S. Birchfield, “Elliptical Head Tracking Using Intensity Gradients and Color Histograms,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 232-237, 1998.
[3] K. Branson and S. Belongie, “Tracking Multiple Mouse Contours (without Too Many Samples),” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1039-1046, 2005.
[4] T. Darrel, G. Gordon, M. Harville, and J. Woodfill, “Integrated Person Tracking Using Stereo, Color, and Pattern Detection,” Int'l J. Computer Vision, vol. 37, no. 2, pp. 175-185, 2000.
[5] Sequential Monte Carlo in Practice, A. Doucet, N. de Freitas, and N.Gordon, eds. Springer, 2001.
[6] K. Fukunaga, Introduction to Statistical Pattern Recognition, second ed. Academic Press, 1990.
[7] G. Hager and P. Belhumeur, “Efficient Region Tracking with Parametric Models of Geometry and Illumination,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 10, pp.1125-1139, Oct. 1998.
[8] E. Hayman and J.O. Eklundh, “Probabilistic and Voting Approaches to Cue Integration for Figure-Ground Segmentation,” Proc. Seventh European Conf. Computer Vision, pp. 469-486, 2002.
[9] M. Isard and A. Blake, “Condensation-Conditional Density Propagation for Visual Tracking,” Int'l J. Computer Vision, vol. 29, no. 1, pp. 5-28, 1998.
[10] M. Isard and A. Blake, “ICondensation: Unifying Low-Level and High-Level Tracking in a Stochastic Framework,” Proc. Fifth European Conf. Computer Vision, pp. 893-908, 1998.
[11] R.E. Kalman, “A New Approach to Linear Filtering and Prediction Problems,” Trans. ASME-J. Basic Eng., pp. 35-45, 1960.
[12] Z. Khan, T. Balch, and F. Dellaert, “A Rao-Blackwellized Particle Filter for Eigentracking,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 980-986, 2004.
[13] M. Kass, A. Witkin, and D. Terzopoulos, “Snakes: Active Contour Models,” Int'l J. Computer Vision, vol. 1, pp. 321-331, 1987.
[14] S. Khan and M. Shah, “Object Based Segmentation of Video Using Color, Motion, and Spatial Information,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 746-751, 2001.
[15] I. Leichter, M. Lindenbaum, and E. Rivlin, “A Probabilistic Framework for Combining Tracking Algorithms,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 445-451, 2004.
[16] J. MackCormick and A. Blake, “Probabilistic Exclusion and Partitioned Sampling for Multiple Object Tracking,” Int'l J.Computer Vision, vol. 39, pp. 57-71, 2000.
[17] J. MacCormick and M. Isard, “Partitioned Sampling, Articulated Objects, and Interface-Quality Hand Tracking,” Proc. Sixth European Conf. Computer Vision, vol. 2, pp. 3-19, 2000.
[18] J. Malik, S. Belongie, J. Shi, and T. Leung, “Textons, Contours and Regions: Cue Integration in Image Segmentation,” Proc. Int'l Conf. Computer Vision, pp. 918-925, 1999.
[19] F. Moreno-Noguer, A. Sanfeliu, and D. Samaras, “Integration of Conditionally Dependent Object Features for Robust Figure/Background Segmentation,” Proc. 10th Int'l Conf. Computer Vision, pp. 1713-1720, 2005.
[20] F. Moreno-Noguer, A. Sanfeliu, and D. Samaras, “A Target Dependent Colorspace for Robust Tracking,” Proc. 18th Int'l Conf. Pattern Recognition, vol. 3, pp. 43-46, 2006.
[21] K. Nummiaro, E. Koller-Meier, and L. Van Gool, “An Adaptive Color-Based Particle Filter,” Image and Vision Computing, vol. 2, no. 1, pp. 99-110, 2003.
[22] C. Rasmussen and G.D. Hager, “Probabilistic Data Association Methods for Tracking Complex Visual Objects,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 560-576, June 2001.
[23] H. Sidenbladh, M.J. Black, and D.J. Fleet, “Stochastic Tracking of 3D Human Figures Using 2D Image Motion,” Proc. Sixth European Conf. Computer Vision, pp. 702-718, 2000.
[24] M. Spengler and B. Schiele, “Towards Robust Multi-Cue Integration for Visual Tracking,” Machine Vision and Applications, vol. 14, no. 1, pp. 50-58, 2003.
[25] P. Torr, R. Szelinski, and P. Anandan, “An Integrated Bayesian Approach to Layer Extraction from Image Sequences,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 3, pp. 297-303, Mar. 2001.
[26] K. Toyama and E. Horvitz, “Bayesian Modality Fusion: Probabilistic Integration of Multiple Vision Cues for Head Tracking,” Proc. Fourth Asian Conf. Computer Vision, 2000.
[27] J. Triesch and C. von der Malsburg, “Democratic Integration: Self-Organized Integration of Adaptive Cues,” Neural Computation, vol. 13, no. 9, pp. 2049-2074, 2001.
[28] Y. Wu and T.S. Huang, “Robust Visual Tracking by Integrating Multiple Cues Based on Co-Inference Learning,” Int'l J. Computer Vision, vol. 58, no. 1, pp. 55-71, 2004.
41 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool