| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Detecting Moving Shadows: Algorithms and Evaluation
July 2003 (vol. 25 no. 7)
pp. 918-923
Abstract—Moving shadows need careful consideration in the development of robust dynamic scene analysis systems. Moving shadow detection is critical for accurate object detection in video streams since shadow points are often misclassified as object points, causing errors in segmentation and tracking. Many algorithms have been proposed in the literature that deal with shadows. However, a comparative evaluation of the existing approaches is still lacking. In this paper, we present a comprehensive survey of moving shadow detection approaches. We organize contributions reported in the literature in four classes two of them are statistical and two are deterministic. We also present a comparative empirical evaluation of representative algorithms selected from these four classes. Novel quantitative (detection and discrimination rate) and qualitative metrics (scene and object independence, flexibility to shadow situations, and robustness to noise) are proposed to evaluate these classes of algorithms on a benchmark suite of indoor and outdoor video sequences. These video sequences and associated “ground-truth” data are made available at http://cvrr.ucsd.edu/aton/shadow to allow for others in the community to experiment with new algorithms and metrics.
[1] 918 R. Irving and D. McKeown, “Methods for Exploiting the Relationship between Buildings and Their Shadows in Aerial Imagery,” IEEE Trans. Systems, Man, and Cybernetics, vol. 19, no. 6, pp. 1564-1575, Nov./Dec. 1989.[2] Y. Liow and T. Pavlidis, Use of Shadows for Extracting Buildings in Aerial Images Computer Vision, Graphics, and Image Processing, vol. 49, no. 2, pp. 242-277, Feb. 1990.[3] G. Medioni, Obtaining 3-D from Shadows in Aerial Images Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 73-76, 1983.[4] C. Wang, L. Huang, and A. Rosenfeld, Detecting Clouds and Cloud Shadows on Aerial Photographs Pattern Recognition Letters, vol. 12, no. 1, pp. 55-64, Jan. 1991.[5] S.A. Shafer and T. Kanade, Using Shadows in Finding Surface Orientations Computer Vision, Graphics, and Image Processing, vol. 22, no. 1, pp. 145-176, Apr. 1983.[6] C. Jiang and M.O. Ward, Shadow Identification Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 606-612, 1992.[7] J. Stauder, R. Mech, and J. Ostermann, Detection of Moving Cast Shadows for Object Segmentation IEEE Trans. Multimedia, vol. 1, no. 1, pp. 65-76, Mar. 1999.[8] I. Mikic, P. Cosman, G. Kogut, and M.M. Trivedi, Moving Shadow and Object Detection in Traffic Scenes Proc. Int'l Conf. Pattern Recognition, vol. 1, pp. 321-324, Sept. 2000.[9] M.M. Trivedi, I. Mikic, and G. Kogut, Distributed Video Networks for Incident Detection and Management Proc. IEEE Int'l Conf. Intelligent Transportation Systems, pp. 155-160, Oct. 2000.[10] A. Elgammal, D. Harwood, and L.S. Davis, Non-Parametric Model for Background Subtraction Proc. IEEE Int'l Conf. Computer Vision '99 FRAME-RATE Workshop, 1999.[11] T. Horprasert, D. Harwood, and L.S. Davis, A Statistical Approach for Real-Time Robust Background Subtraction and Shadow Detection Proc. IEEE Int'l Conf. Computer Vision '99 FRAME-RATE Workshop, 1999.[12] N. Friedman and S. Russell, Image Segmentation in Video Sequences: A Probabilistic Approach Proc. 13th Conf. Uncertainty in Artificial Intelligence, 1997.[13] R. Cucchiara, C. Grana, G. Neri, M. Piccardi, and A. Prati, The Sakbot System for Moving Object Detection and Tracking Video-Based Surveillance Systems Computer Vision and Distributed Processing, pp. 145-157, 2001.[14] D. Koller, K. Daniilidis, and H.-H. Nagel, "Model-based object tracking in monocular image sequence of road traffic scenes," Int'l J. Computer Vision, vol. 10, no. 3, pp. 257-281, 1993.[15] K. Toyama, J. Krumm, B. Brumitt, and B. Meyers, “Wallflower: Principles and Practice of Background Maintenance,” Proc. Seventh Int'l Conf. Computer Vision, pp. 255-261, 1999.[16] X. Tao, M. Guo, and B. Zhang, A Neural Network Approach to the Elimination of Road Shadow for Outdoor Mobile Robot Proc. IEEE Int'l Conf. Intelligent Processing Systems, vol. 2, pp. 1302-1306, 1997.[17] S.J. McKenna, S. Jabri, Z. Duric, A. Rosenfeld, and H. Wechsler, Tracking Groups of People Computer Vision and Image Understanding, vol. 80, no. 1, pp. 42-56, Oct. 2000.[18] J.M. Scanlan, D.M. Chabries, and R.W. Christiansen, A Shadow Detection and Removal Algorithm for 2-D Images Proc. Int'l Conf. Acoustics, Speech, and Signal Processing, vol. 4, pp. 2057-2060, 1990.[19] M. Kilger, A Shadow Handler in a Video-Based Real-Time Traffic Monitoring System Proc. IEEE Workshop Applications of Computer Vision, pp. 11-18, 1992.[20] N.M. Charkari and H. Mori, A New Approach for Real Time Moving Vehicle Detection Proc. IEEE/RSJ Int'l Conf. Intelligent Robots and Systems, pp. 273-278, 1993.[21] G.G. Sexton and X. Zhang, Suppression of Shadows for Improved Object Discrimination Proc. IEE Colloquium Image Processing for Transport Applications, pp. 1-6, Dec. 1993.[22] K. Onoguchi, Shadow Elimination Method for Moving Object Detection Proc. Int'l Conf. Pattern Recognition, vol. 1, pp. 583-587, 1998.[23] G. Funka-Lea and R. Bajcsy, Combining Color and Geometry for the Active, Visual Recognition of Shadows Proc. IEEE Int'l Conf. Computer Vision, pp. 203-209, 1995.[24] Y. Sonoda and T. Ogata, Separation of Moving Objects and Their Shadows, and Application to Tracking of Loci in the Monitoring Images Proc. Int'l Conf. Signal Processing, pp. 1261-1264, 1998.[25] C. Tzomakas and W. von Seelen, Vehicle Detection in Traffic Scenes Using Shadows Technical Report 98-06, IR-INI, Institut fur Nueroinformatik, Ruhr-Universitat Bochum, FRG, Germany, Aug. 1998.[26] N. Amamoto and A. Fujii, Detecting Obstructions and Tracking Moving Objects by Image Processing Technique Electronics and Comm. in Japan, Part 3, vol. 82, no. 11, pp. 28-37, 1999.[27] A. Prati, R. Cucchiara, I. Mikic, and M.M. Trivedi, Analysis and Detection of Shadows in Video Streams: A Comparative Evaluation Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2001.[28] I. Haritaoglu, D. Harwood, and L. Davis, $\rm W^4$: Real-Time Surveillance of People and Their Activities IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 809-830, Aug. 2000.[29] N. Herodotou, K.N. Plataniotis, and A.N. Venetsanopoulos, A Color Segmentation Scheme for Object-Based Video Coding Proc. IEEE Symp. Advances in Digital Filtering and Signal Processing, pp. 25-29, 1998.[30] R. Cucchiara, C. Grana, M. Piccardi, A. Prati, and S. Sirotti, Improving Shadow Suppression in Moving Object Detection with HSV Color Information Proc. IEEE Int'l Conf. Intelligent Transportation Systems, pp. 334-339, Aug. 2001.[31] P. Villegas, X. Marichal, and A. Salcedo, Objective Evaluation of Segmentation Masks in Video Sequences Proc. Workshop Image Analysis for Multimedia Interactive Services, pp. 85-88, May 1999.[32] G. Medioni, Detecting and Tracking Moving Objects for Video Surveillance Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 319-325, 1999.
Index Terms:
Shadow detection, performance evaluation, object detection, segmentation, traffic scene analysis, visual surveillance.
Citation:
Andrea Prati, Ivana Mikic, Mohan M. Trivedi, Rita Cucchiara, "Detecting Moving Shadows: Algorithms and Evaluation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 7, pp. 918-923, July 2003, doi:10.1109/TPAMI.2003.1206520
