The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.11 - November (2008 vol.30)
pp: 2055-2063
Ajay J. Joshi , University of Minnesota, Minneapolis
Nikos P. Papanikolopoulos , University of Minnesota, Minneapolis
ABSTRACT
We propose a novel adaptive technique for detecting moving shadows and distinguishing them from moving objects in video sequences. Most methods for detecting shadows work in a static setting with significant human input. To remove these limitations, we propose a more general semi-supervised learning technique to tackle the problem. First, we exploit characteristic differences in color and edges in the video frames to come up with a set of features useful for classification. Second, we use a learning technique that employs Support Vector Machines and the Co-training algorithm, that relies on a small set of human-labeled data. We observe a surprising phenomenon that Co-training can counter the effects of changing underlying probability distributions in the feature space. From the standpoint of detecting shadows, once deployed, the proposed method can dynamically adapt to varying conditions without any manual intervention, and performs better classification than previous methods on static and dynamic environments alike. The strengths of the proposed technique are the small quantity of human labeled data required, and the ability to adapt automatically to changing scene conditions.
INDEX TERMS
Shadow Detection, Applications, Computer vision, Semi-Supervised Learning, Co-Training, Population Drift
CITATION
Ajay J. Joshi, Nikos P. Papanikolopoulos, "Learning to Detect Moving Shadows in Dynamic Environments", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.30, no. 11, pp. 2055-2063, November 2008, doi:10.1109/TPAMI.2008.150
REFERENCES
[1] A. Prati, I. Mikic, M.M. Trivedi, and R. Cucchiara, “Detecting Moving Shadows: Algorithms and Evaluation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 7, pp. 918-923, July 2003.
[2] F. Porikli and J. Thornton, “Shadow Flow: A Recursive Method to Learn Moving Cast Shadows,” Proc. 10th IEEE Int'l Conf. Computer Vision, 2005.
[3] Y. Wang, K. Loe, and J. Wu, “A Dynamic Conditional Random Field Model for Foreground and Shadow Segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 2, pp. 279-289, Feb. 2006.
[4] J. Sun, W. Zhang, X. Tang, and H. Shum, “Background Cut,” Proc. Ninth European Conf. Computer Vision, 2006.
[5] S. McKenna, S. Jabri, Z. Duric, H. Wechsler, and A. Rosenfeld, “Tracking Groups of People,” Computer Vision and Image Understanding, vol. 80, no. 1, pp. 42-56, 2000.
[6] L. Li and M. Leung, “Integrating Intensity and Texture Differences for Robust Change Detection,” IEEE Trans. Image Processing, vol. 11, no. 2, pp.105-112, Feb. 2002.
[7] O. Javed, K. Shafique, and M. Shah, “A Hierarchical Approach to Robust Background Subtraction Using Color and Gradient Information,” Proc. Workshop Motion and Video Computing, 2002.
[8] R. Hewitt and S. Belongie, “Active Learning in Face Recognition: Using Tracking to Build a Face Model,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2006.
[9] A. Levin, P. Viola, and Y. Freund, “Unsupervised Improvement of Visual Detectors Using Co-Training,” Proc. Ninth IEEE Int'l Conf. Computer Vision, 2003.
[10] O. Javed, S. Ali, and M. Shah, “Online Detection and Classification of Moving Objects Using Progressively Improving Detectors,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2005.
[11] D. Guan, W. Yuan, Y. Lee, A. Gavrilov, and S. Lee, “Activity Recognition Based on Semi-Supervised Learning,” Proc. 11th IEEE Int'l Conf. Embedded and Real-Time Computing Systems and Applications, 2007.
[12] S. Jabri, Z. Duric, H. Wechsler, and A. Rosenfeld, “Detection and Location of People in Video Images Using Adaptive Fusion of Color and Edge Information,” Proc. 15th Int'l Conf. Pattern Recognition, 2000.
[13] A. Ferencz, E. Learned-Miller, and J. Malik, “Building a Classification Cascade for Visual Identification from One Example,” Proc. 10th IEEE Int'l Conf. Computer Vision, 2005.
[14] F. Tang, S. Brennen, Q. Zhao, and H. Tao, “Co-Tracking Using Semi-Supervised Support Vector Machines,” Proc. 11th IEEE Int'l Conf. Computer Vision, 2007.
[15] A. Jepson, D. Fleet, and T. El-Maraghi, “Robust Online Appearance Models for Visual Tracking,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 10, pp. 1296-1311, Oct. 2003.
[16] V. Nair and J. Clark, “An Unsupervised Online Learning Framework for Moving Object Detection,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2004.
[17] L. Elgammel, D. Harwood, and L.S. Davis, “Non-Parametric Model for Background Subtraction,” Proc. IEEE ICCV FRAME-RATE Workshop, 1999.
[18] S. Tattersall and K. Dawson-Howe, “Adaptive Shadow Identification through Automatic Parameter Estimation in Video Sequences,” Proc. Irish Machine Vision and Image Processing Conf., pp. 57-64, Sept. 2003.
[19] T. Horprasert, D. Harwood, and L.S. Davis, “A Statistical Approach for Real-Time Robust Background Subtraction and Shadow Detection,” Proc. IEEE ICCV FRAME-RATE Workshop, 1999.
[20] M. Kilger, “A Shadow-Handler in a Video-Based Real-Time Traffic Monitoring System,” Proc. IEEE Workshop Applications of Computer Vision, pp. 11-18, 1992.
[21] C. Stauffer and W.E.L. Grimson, “Adaptive Background Mixture Models for Real-Time Tracking,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 2, 1999.
[22] A.J. Joshi, S. Atev, O. Masoud, and N. Papanikolopoulos, “Moving Shadow Detection with Low- and Mid-Level Reasoning,” Proc. IEEE Int'l Conf. Robotics and Automation, 2007.
[23] S. Atev, O. Masoud, and N. Papanikolopoulos, “Practical Mixtures of Gaussians with Brightness Monitoring,” Proc. IEEE Seventh Int'l Conf. Intelligent Transportation Systems, pp. 423-428, Oct. 2004.
[24] K. Nigam and R. Ghani, “Analyzing the Effectiveness and Applicability of Co-Training,” Proc. Ninth Int'l Conf. Information and Knowledge Management, 2000.
[25] A. Blum and T. Mitchell, “Combining Labeled and Unlabeled Data with Co-Training,” Proc. 11th Ann. Conf. Computational Learning Theory, 1998.
[26] C. Chang and C. Lin, “LIBSVM: A Library for Support Vector Machines,” http://www.csie.ntu.edu.tw/~cjlinlibsvm/, 2001.
[27] K. Nigam, A.K. McCallum, S. Thrun, and T. Mitchell, “Text Classification from Labeled and Unlabeled Documents Using EM,” Machine Learning, 2000.
[28] Y. Lin, Y. Lee, and G. Wahba, “Support Vector Machines for Classification in Nonstandard Situations,” Machine Learning, 2002.
[29] D.J. Newman, S. Hettich, C.L. Blake, and C.J. Merz, “UCI Repository of Machine Learning Databases,” School of Information and Computer Science, Univ. of California, Irvine, 2007.
[30] CAVIAR Database, EC Funded CAVIAR Project/IST 2001 37540, http://homepages.inf.ed.ac.uk/rbfCAVIAR/, 2001.
14 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool