This Article 
 Bibliographic References 
 Add to: 
Detecting Moving Objects, Ghosts, and Shadows in Video Streams
October 2003 (vol. 25 no. 10)
pp. 1337-1342

Abstract—Background subtraction methods are widely exploited for moving object detection in videos in many applications, such as traffic monitoring, human motion capture, and video surveillance. How to correctly and efficiently model and update the background model and how to deal with shadows are two of the most distinguishing and challenging aspects of such approaches. This work proposes a general-purpose method that combines statistical assumptions with the object-level knowledge of moving objects, apparent objects (ghosts), and shadows acquired in the processing of the previous frames. Pixels belonging to moving objects, ghosts, and shadows are processed differently in order to supply an object-based selective update. The proposed approach exploits color information for both background subtraction and shadow detection to improve object segmentation and background update. The approach proves fast, flexible, and precise in terms of both pixel accuracy and reactivity to background changes.

[1] I. Haritaoglu, D. Harwood, and L. Davis, $\rm W^4$: Real-Time Surveillance of People and Their Activities IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 809-830, Aug. 2000.
[2] N. Amamoto and A. Fujii, Detecting Obstructions and Tracking Moving Objects by Image Processing Technique Electronics and Comm. Japan, Part 3, vol. 82, no. 11, pp. 28-37, 1999.
[3] C. Stauffer and W.E.L. Grimson, Learning Patterns of Activity Using Real-Time Tracking IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 747-757, Aug. 2000.
[4] S.J. McKenna, S. Jabri, Z. Duric, A. Rosenfeld, and H. Wechsler, Tracking Groups of People Computer Vision and Image Understanding, vol. 80, no. 1, pp. 42-56, Oct. 2000.
[5] C. Wren, A. Azarbayejani, T. Darrell, and A.P. Pentland, Pfinder: Real-Time Tracking of the Human Body IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 780-785, July 1997.
[6] M. Seki, H. Fujiwara, and K. Sumi, A Robust Background Subtraction Method for Changing Background Proc. IEEE Workshop Applications of Computer Vision, pp. 207-213, 2000.
[7] N. Ohta, A Statistical Approach to Background Suppression for Surveillance Systems Proc. IEEE Int'l Conf. Computer Vision, pp. 481-486, 2001.
[8] D. Koller, J. Weber, T. Huang, J. Malik, G. Ogasawara, B. Rao, and S. Russell, "Towards robust automatic traffic scene analysis in real-time," Proc. Int'l Conf. Pattern Recognition,Jerusalem, Israel, pp. 126-131, 1994.
[9] R. Cucchiara, C. Grana, M. Piccardi, A. Prati, and S. Sirotti, Improving Shadow Suppression in Moving Object Detection with HSV Color Information Proc. IEEE Int'l Conf. Intelligent Transportation Systems, pp. 334-339, Aug. 2001.
[10] A. Elgammal, D. Harwood, and L.S. Davis, Non-Parametric Model for Background Subtraction Proc. IEEE Int'l Conf. Computer Vision '99 FRAME-RATE Workshop, 1999.
[11] B.P.L. Lo and S.A. Velastin, Automatic Congestion Detection System for Underground Platforms Proc. Int'l Symp. Intelligent Multimedia, Video, and Speech Processing, pp. 158-161, 2000.
[12] B. Gloyer, H.K. Aghajan, K.Y. Siu, and T. Kailath, Video-Based Freeway Monitoring System Using Recursive Vehicle Tracking Proc. SPIE Symp. Electronic Imaging: Image and Video Processing, 1995
[13] S. Jabri, Z. Duric, H. Wechsler, and A. Rosenfeld, Detection and Location of People in Video Images Using Adaptive Fusion of Color and Edge Information Proc. Int'l Conf. Pattern Recognition, pp. 627-630, 2000.
[14] C. Stauffer and W.E.L. Grimson, Adaptive Background Mixture Models for Real-Time Tracking Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 246-252, 1999.
[15] N. Oliver, B. Rosario, and A. Pentland, "A Bayesian Computer Vision System for Modeling Human Interactions," IEEE Trans. Pattern Analysis and Machine Intelligence, Aug. 2000, pp. 831-843.
[16] N. Rota and M. Thonnat, Video Sequence Interpretation for Visual Surveillance Proc. IEEE Workshop Visual Surveillance (VS '00), pp. 325-332, 2000.
[17] A. Prati, R. Cucchiara, I. Mikic, and M.M. Trivedi, Analysis and Detection of Shadows in Video Streams: A Comparative Evaluation Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2001.
[18] A. Bainbridge-Smith and R. G. Lane, Determining Optical Flow Using a Differential Method Image and Vision Computing, vol. 15, pp. 11-22, 1997.
[19] R. Cucchiara, C. Grana, and A. Prati, Semantic Transcoding for Live Video Server Proc. ACM Multimedia 2002 Conf., pp. 223-226, Dec. 2002.

Index Terms:
Background modeling, color segmentation, reactivity to changes, shadow detection, video surveillance, object-level knowledge.
Rita Cucchiara, Costantino Grana, Massimo Piccardi, Andrea Prati, "Detecting Moving Objects, Ghosts, and Shadows in Video Streams," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 10, pp. 1337-1342, Oct. 2003, doi:10.1109/TPAMI.2003.1233909
Usage of this product signifies your acceptance of the Terms of Use.