The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.04 - April (2008 vol.30)
pp: 746-751
ABSTRACT
A framework for robust foreground detection that works under difficult conditions such as dynamic background and moderately moving camera is presented in this paper. The proposed method includes two main components: coarse scene representation as the union of pixel layers, and foreground detection in video by propagating these layers using a maximum-likelihood assignment. We first cluster into "layers" those pixels that share similar statistics. The entire scene is then modeled as the union of such non-parametric layer-models. An in-coming pixel is detected as foreground if it does not adhere to these adaptive models of the background. A principled way of computing thresholds is used to achieve robust detection performance with a pre-specified number of false alarms. Correlation between pixels in the spatial vicinity is exploited to deal with camera motion without precise registration or optical flow. The proposed technique adapts to changes in the scene, and allows to automatically convert persistent foreground objects to background and re-convert them to foreground when they become {\emph{interesting}}. This simple framework addresses the important problem of robust foreground and unusual region detection, at about 10 frames per second on a standard laptop computer. The presentation of the proposed approach is complemented by results on challenging real data and comparisons with other standard techniques.
INDEX TERMS
Scene Analysis, Pixel classification
CITATION
Kedar Patwardhan, Guillermo Sapiro, Vassilios Morellas, "Robust Foreground Detection In Video Using Pixel Layers", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.30, no. 4, pp. 746-751, April 2008, doi:10.1109/TPAMI.2007.70843
REFERENCES
[1] R.C. Jain and H.H. Nagel, “On the Analysis of Accumulative Difference Pictures from Image Sequences of Real World Scenes,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 1, no. 2, pp. 206-213, Apr. 1979.
[2] Detailed version of this paper available at http://www.tc.umn.edu/~patw0007videolayers /, June 2006.
[3] C.R. Wren, A. Azarbayejani, T. Darrell, and A. Pentland, “Pfinder: Real-Time Tracking of the Human Body,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 780-785, July 1997.
[4] N. Friedman and S.J. Russell, “Image Segmentation in Video Sequences: A Probabilistic Approach,” Proc. 13th Conf. Uncertainity in Airtificial Intelligence, pp. 175-181, 1997.
[5] C. Stauffer and W.E.L. Grimson, “Learning Patterns of Activity Using Real-Time Tracking,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 747-757, Aug. 2000.
[6] V. Morellas, I. Pavlidis, and P. Tsiamyrtzis, “Deter: Detection of Events for Threat Evaluation and Recognition,” Machine Vision Application, vol. 15, no. 1, pp. 29-45, 2003.
[7] K. Kim, T.H. Chalidabhongse, D. Harwood, and L.S. Davis, “Real-Time Foreground-Background Segmentation Using Codebook Model,” Real-Time Imaging, vol. 11, no. 3, pp. 172-185, 2005.
[8] A. Mittal and N. Paragios, “Motion-Based Background Subtraction Using Adaptive Kernel Density Estimation,” Proc. Int'l Conf. Computer Vision and Pattern Recognition, pp. 302-309, 2004.
[9] A.M. Elgammal, D. Harwood, and L.S. Davis, “Non-Parametric Model for Background Subtraction,” Proc. European Conf. Computer Vision, pp. 751-767, 2000.
[10] Y. Sheikh and M. Shah, “Bayesian Modeling of Dynamic Scenes for Object Detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 11, pp. 1778-1792, Nov. 2005.
[11] K. Toyama, J. Krumm, B. Brumitt, and B. Meyers, “Wallflower: Principles and Practice of Background Maintenance,” Proc. IEEE Int'l Conf. Computer Vision, pp. 255-261, 1999.
[12] J. Zhong and S. Sclaroff, “Segmenting Foreground Objects from a Dynamic Textured Background via a Robust Kalman Filter,” Proc. IEEE Int'l Conf. Computer Vision, pp. 44-50, 2003.
[13] E.H. Adelson, “Layered Representation for Vision and Video,” Representation of Visual Scenes, in conjunction with Proc. IEEE Int'l Conf. Computer Vision, p. 3, 1995.
[14] H. Tao, H.S. Sawhney, and R. Kumar, “Object Tracking with Bayesian Estimation of Dynamic Layer Representations,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 1, pp. 75-89, Jan. 2002.
[15] A. Criminisi, G. Cross, A. Blake, and V. Kolmogorov, “Bilayer Segmentation of Live Video,” Proc. Int'l Conf. Computer Vision and Pattern Recognition, pp. 53-60, 2006.
[16] Y. Weiss, “Smoothness in Layers: Motion Segmentation Using Nonparametric Mixture Estimation,” Proc. Int'l Conf. Computer Vision and Pattern Recognition, p. 520, 1997.
[17] S. Khan and M. Shah, “Object Based Segmentation of Video Using Color Motion and Spatial Information,” Proc. Int'l Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 746-751, 2001, citeseer.ist.psu.edukhan01object.html,
[18] Y. Zhou and H. Tao, “A Background Layer Model for Object Tracking through Occlusion,” Proc. IEEE Int'l Conf. Computer Vision, p. 1079, 2003.
[19] D. Comaniciu and P. Meer, “Robust Analysis of Feature Spaces: Color Image Segmentation,” Proc. Int'l Conf. Computer Vision and Pattern Recognition, p. 750, 1997.
[20] G. Wyszecki and W.S. Stiles, Color Science: Concepts and Methods, Quantitative Data and Formulae. Wiley, 1982.
[21] L. Zhao and L.S. Davis, “Iterative Figure-Ground Discrimination,” Proc. Int'l Conf. Pattern Recognition, pp. 67-70, 2004.
[22] B.W. Silverman, Density Estimation for Statistics and Data Analysis. Chapman and Hall, 1986.
[23] D.W. Scott, Multivariate Density Estimation. Wiley Inter-Science, 1992.
[24] C. Yang, R. Duraiswami, N. Gumerov, and L. Davis, “Improved Fast Gauss Transform and Efficient Kernel Density Estimation,” Proc. IEEE Int'l Conf. Computer Vision, pp. 464-471, 2003, citeseer.ist.psu.eduyang03improved.html,
[25] F. Cao, Y. Gousseau, P. Muse, F. Sur, and J.-M. Morel, “Accurate Estimates of False Alarm Number in Shape Recognition,” technical report, 2004, http://www.cmla.ens-cachan.frCmla/, citeseer.ist.psu.edumuse04 accurate.html .
[26] T. Veit, F. Cao, and P. Bouthemy, “An a contrario Framework for Motion Detection,” Technical Report 5313, INRIA, 2004, http://www.irisa.fr/vista/Publis/AuteurFrederic.Cao.english.html ,
[27] D.H. Kyungnam Kim and L.S. Davis, “Background Updating for Visual Surveillance,” Proc. Int'l Symp. Visual Computing, 2005.
15 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool