This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
A Dynamic Conditional Random Field Model for Foreground and Shadow Segmentation
February 2006 (vol. 28 no. 2)
pp. 279-289
This paper proposes a dynamic conditional random field (DCRF) model for foreground object and moving shadow segmentation in indoor video scenes. Given an image sequence, temporal dependencies of consecutive segmentation fields and spatial dependencies within each segmentation field are unified by a dynamic probabilistic framework based on the conditional random field (CRF). An efficient approximate filtering algorithm is derived for the DCRF model to recursively estimate the segmentation field from the history of observed images. The foreground and shadow segmentation method integrates both intensity and gradient features. Moreover, models of background, shadow, and gradient information are updated adaptively for nonstationary background processes. Experimental results show that the proposed approach can accurately detect moving objects and their cast shadows even in monocular grayscale video sequences.

[1] J. Besag, “On the Statistical Analysis of Dirty Pictures,” J. Royal Statistical Soc. B, vol. 48, pp. 259-302, 1986.
[2] T.E. Boult, R.J. Micheals, X. Gao, and M. Eckmann, “Into the Woods: Visual Surveillance of Noncooperative and Camouflaged Targets in Complex Outdoor Settings,” Proc. IEEE, vol. 89, pp. 1382-1402, 2001.
[3] R. Cucchiara, C. Grana, M. Piccardi, and A. Prati, “Detecting Moving Objects, Ghosts, and Shadows in Video Streams,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, pp. 1337-1342, 2003.
[4] G. Doretto, D. Cremers, P. Favaro, and S. Soatto, “Dynamic Texture Segmentation,” Proc. Int'l. Conf. Computer Vision, vol. 2, pp. 1236-1242, 2003.
[5] A. Elgammal, R. Duraiswami, D. Harwood, and L.S. Davis, “Background and Foreground Modeling Using Nonparametric Kernel Density Estimation for Visual Surveillance,” Proc. IEEE, vol. 90, pp. 1151-1163, 2002.
[6] N. Friedman and S. Russell, “Image Segmentation in Video Sequences: A Probabilistic Approach,” Proc. Conf. Uncertainty in Artificial Intelligence, pp. 175-181, 1997.
[7] G. Gordon, T. Darrell, M. Harville, and J. Woodfill, “Background Estimation and Removal Based on Range and Color,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 459-464, 1999.
[8] I. Haritaoglu, D. Harwood, and L.S. Davis, “$\rm W^4$ : Real-Time Surveillance of People and Their Activities,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, pp. 809-830, 2000.
[9] T. Horprasert, D. Harwood, and L.S. Davis, “A Statistical Approach for Real-Time Robust Background Subtraction and Shadow Detection,” Proc. FRAME-RATE Workshop, 1999.
[10] Y. Ivanov, A. Bobick, and J. Liu, “Fast Light Independent Background Subtraction,” Int'l. J. Computer Vision, vol. 37, pp. 199-207, 2000.
[11] S. Jabri, Z. Duric, H. Wechsler, and A. Rosenfeld, “Detection and Location of People in Video Images Using Adaptive Fusion of Color and Edge Information,” Proc. Int'l Conf. Pattern Recognition, vol. 4, pp. 627-630, 2000.
[12] S. Kamijo, K. Ikeuchi, and M. Sakauchi, “Segmentations of Spatio-Temporal Images by Spatio-Temporal Markov Random Field Model,” Proc. EMMCVPR Workshop, pp. 298-313, 2001.
[13] D. Koller, J. Weber, T. Huang, J. Malik, G. Ogasawara, B. Rao, and S. Russell, “Towards Robust Automatic Traffic Scene Analysis in Real-Time,” Proc. Int'l Conf. Pattern Recognition, vol. 1, pp. 126-131, 1994.
[14] J. Lafferty, A. McCallum, and F. Pereira, “Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data,” Proc. Int'l Conf. Machine Learning, pp. 282-289, 2001.
[15] S.Z. Li, Markov Random Field Modeling in Image Analysis. Springer-Verlag, 2001.
[16] S.J. McKenna, S. Jabri, Z. Duric, A. Rosenfeld, and H. Wechsler, “Tracking Groups of People,” Computer Vision and Image Understanding, vol. 80, pp. 42-56, 2000.
[17] I. Mikic, P.C. Cosman, G.T. Kogut, and M.M. Trivedi, “Moving Shadow and Object Detection in Traffic Scenes,” Proc. Int'l Conf. Pattern Recognition, vol. 1, pp. 321-324, 2000.
[18] N. Paragios and V. Ramesh, “A MRF-Based Approach for Real-Time Subway Monitoring,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 1034-1040, 2001.
[19] A. Prati, I. Mikic, M.M. Trivedi, and R. Cucchiara, “Detecting Moving Shadows: Algorithms and Evaluation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, pp. 918-923, 2003.
[20] J. Rittscher, J. Kato, S. Joga, and A. Blake, “A Probabilistic Background Model for Tracking,” Proc. European Conf. Computer Vision, vol. 2, pp. 336-350, 2000.
[21] M. Seki, T. Wada, H. Fujiwara, and K. Sumi, “Background Subtraction Based on Cooccurrence of Image Variations,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 65-72, 2003.
[22] J. Stauder, R. Mech, and J. Ostermann, “Detection of Moving Cast Shadows for Object Segmentation,” IEEE Trans. Multimedia, vol. 1, pp. 65-76, 1999.
[23] C. Stauffer and W.E.L. Grimson, “Learning Patterns of Activity Using Real-Time Tracking,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, pp. 747-757, 2000.
[24] B. Stenger, V. Ramesh, N. Paragios, F. Coetzee, and J.M. Buhmann, “Topology Free Hidden Markov Models: Application to Background Modeling,” Proc. Int'l Conf. Computer Vision, vol. 1, pp. 294-301, 2001.
[25] K. Toyama, J. Krumm, B. Brumitt, and B. Meyers, “Wallflower: Principles and Practice of Background Maintenance,” Proc. Int'l Conf. Computer Vision, vol. 1, pp. 255-261, 1999.
[26] Y. Wang, T. Tan, K.-F. Loe, and J.-K. Wu, “A Probabilistic Approach for Foreground and Shadow Segmentation in Monocular Image Sequences,” Pattern Recognition, vol. 38, pp. 1937-1946, 2005.
[27] C.R. Wren, A. Azarbayejani, T. Darrell, and A.P. Pentland, “Pfinder: Real-Time Tracking of the Human Body,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, pp. 780-785, 1997.

Index Terms:
Index Terms- Conditional random fields, dynamic models, foreground segmentation, shadow detection.
Citation:
Yang Wang, Kia-Fock Loe, Jian-Kang Wu, "A Dynamic Conditional Random Field Model for Foreground and Shadow Segmentation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 2, pp. 279-289, Feb. 2006, doi:10.1109/TPAMI.2006.25
Usage of this product signifies your acceptance of the Terms of Use.