The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.07 - July (2008 vol.30)
pp: 1186-1197
ABSTRACT
Visual features are commonly modeled with probability density functions in computer vision problems, but current methods such as a mixture of Gaussians and kernel density estimation suffer from either the lack of flexibility, by fixing or limiting the number of Gaussian components in the mixture, or large memory requirement, by maintaining a non-parametric representation of the density. These problems are aggravated in real-time computer vision applications since density functions are required to be updated as new data becomes available. We present a novel kernel density approximation technique based on the mean-shift mode finding algorithm, and describe an efficient method to sequentially propagate the density modes over time. While the proposed density representation is memory efficient, which is typical for mixture densities, it inherits the flexibility of non-parametric methods by allowing the number of components to be variable. The accuracy and compactness of the sequential kernel density approximation technique is illustrated by both simulations and experiments. Sequential kernel density approximation is applied to on-line target appearance modeling for visual tracking, and its performance is demonstrated on a variety of videos.
INDEX TERMS
Computer vision, Computer vision, Statistical, Statistical, Tracking
CITATION
Dorin Comaniciu, Ying Zhu, Bohyung Han, "Sequential Kernel Density Approximation and Its Application to Real-Time Visual Tracking", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.30, no. 7, pp. 1186-1197, July 2008, doi:10.1109/TPAMI.2007.70771
REFERENCES
[1] I. Abramson, “On Bandwidth Variation in Kernel Estimates—A Square Root Law,” The Annals of Statistics, vol. 10, no. 4, pp. 1217-1223, 1982.
[2] M.J. Black and A. Jepson, “Eigentracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation,” Proc. European Conf. Computer Vision, pp. 610-619, 1996.
[3] T. Cham and J. Rehg, “A Multiple Hypothesis Approach to Figure Tracking,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 239-245, 1999.
[4] H. Chen and T. Liu, “Trust-Region Methods for Real-Time Tracking,” Proc. Eighth Int'l Conf. Computer Vision, vol. II, pp.717-722, 2001.
[5] W. Cleveland, “Robust Locally Weighted Regression and Smoothing Scatterplots,” J. Am. Statistical Assoc., vol. 74, pp. 829-836, 1979.
[6] W. Cleveland and C. Loader, “Smoothing by Local Regression: Principles and Methods,” Statistical Theory and Computational Aspects of Smoothing, pp. 10-49, 1996.
[7] D. Comaniciu, “An Algorithm for Data-Driven Bandwidth Selection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 2, pp. 281-288, Feb. 2003.
[8] D. Comaniciu, V. Ramesh, and P. Meer, “Real-Time Tracking of Non-Rigid Objects Using Mean Shift,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. II, pp. 142-149, June 2000.
[9] D. Comaniciu, V. Ramesh, and P. Meer, “The Variable Bandwidth Mean Shift and Data-Driven Scale Selection,” Proc. Eighth Int'l Conf. Computer Vision, vol. I, pp. 438-445, July 2001.
[10] T. Cormen, C. Leiserson, and R. Rivest, Introduction to Algorithms. MIT Press and McGraw-Hill, 1990.
[11] A. Elgammal, R. Duraiswami, and L. Davis, “Probability Tracking in Joint Feature-Spatial Spaces,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2003.
[12] A. Elgammal, R. Duraiswami, D. Harwood, and L. Davis, “Background and Foreground Modeling Using Nonparametric Kernel Density Estimation for Visual Surveillance,” Proc. IEEE, vol. 90, pp. 1151-1163, 2002.
[13] P. Fieguth and D. Teropoulos, “Color-Based Tracking of Heads and other Mobile Objects at Video Frame Rates,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 21-27, 1997.
[14] B. Frey, “Filling in Scenes by Propagating Probabilities through Layers into Appearance Models,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. I, pp. 185-192, 2000.
[15] B. Han, D. Comaniciu, and L. Davis, “Sequential Kernel Density Approximation through Mode Propagation: Applications to Background Modeling,” Proc. Asian Conf. Computer Vision, 2004.
[16] B. Han and L. Davis, “On-Line Density-Based Appearance Modeling for Object Tracking,” Proc. 10th Int'l Conf. Computer Vision, 2005.
[17] I. Haritaoglu, D. Harwood, and L. Davis, “W4: Real-Time Surveillance of People and Their Activities,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 809-830, Aug. 2000.
[18] A. Jepson and M. Black, “Mixture Models for Optical Flow Computation,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 760-761, 1993.
[19] A. Jepson, D. Fleet, and T. El-Maraghi, “Robust Online Appearance Models for Visual Tracking,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. I, pp. 415-422, 2001.
[20] D. Lee, “Effective Gaussian Mixture Learning for Video Background Subtraction,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 5, pp. 827-832, May 2005.
[21] I. Matthews, T. Ishikawa, and S. Baker, “The Template Update Problem,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 6, pp. 810-815, June 2004.
[22] S. McKenna, Y. Raja, and S. Gong, “Tracking Colour Objects Using Adaptive Mixture Models,” Image and Vision Computing J., vol. 17, pp. 223-229, 1999.
[23] R. Neal and G. Hinton, “A View of the EM Algorithm that Justifies Incremental, Sparse, and Other Variants,” Learning in Graphical Models, M.I. Jordan, ed., pp. 355-368, 1998.
[24] H.T. Nguyen, M. Worring, and R. van den Boomgaard, “Occlusion Robust Adaptive Template Tracking,” Proc. Eighth Int'l Conf. Computer Vision, Oct. 2001.
[25] K. Nummiaro, E. Koller-Meier, and L.V. Gool, “An Adaptive Color-Based Particle Filter,” Image and Vision Computing, vol. 21, no. 1, pp. 99-110, 2003.
[26] P. Perez, C. Hue, J. Vermaak, and M. Gangnet, “Color-Based Probabilistic Tracking,” Proc. European Conf. Computer Vision, vol. I, pp. 661-675, 2002.
[27] C. Priebe and D. Marchette, “Adaptive Mixture Density Estimation,” Pattern Recognition, vol. 26, no. 5, pp. 771-785, 1993.
[28] D. Ross, J. Lim, and M. Yang, “Adaptive Probabilistic Visual Tracking with Incremental Subspace Update,” Proc. European Conf. Computer Vision, vol. II, pp. 470-482, May 2004.
[29] C. Stauffer and W. Grimson, “Learning Patterns of Activity Using Real-Time Tracking,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 747-757, Aug. 2000.
[30] O. Tuzel, F. Porikli, and P. Meer, “A Bayesian Approach to Background Modeling,” Proc. Int'l Workshop Machine Vision for Intelligent Vehicles in Conjunction with Computer Vision and Pattern Recognition, 2005.
[31] P. Viola and M. Jones, “Rapid Object Detection Using a Boosted Cascade of Simple Features,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 511-518, 2001.
[32] C. Wren, A. Azarbayejani, T. Darrell, and A. Pentland, “Pfinder: Real-Time Tracking of the Human Body,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, pp. 780-785, 1997.
[33] C. Yang, R. Duraiswami, N. Gumerov, and L. Davis, “Improved Fast Gauss Transform and Efficient Kernel Density Estimation,” Proc. Ninth Int'l Conf. Computer Vision, vol. I, pp. 464-471, 2003.
16 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool