loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors
March 2008 (vol. 30 no. 3)
pp. 555-560
We present a novel algorithm for detection of certain types of unusual events. The algorithm is based on multiple local monitors which collect low-level statistics. Each local monitor produces an alert if its current measurement is unusual, and these alerts are integrated to a final decision regarding the existence of an unusual event. Our algorithm satisfies a set of requirements that are critical for successful deployment of any large-scale surveillance system. In particular it requires a minimal setup (taking only a few minutes) and is fully automatic afterwards. Since it is not based on objects' tracks, it is robust and works well in crowded scenes where tracking-based algorithms are likely to fail. The algorithm is effective as soon as sufficeint low-level observations representing the routine activity have been collected, which usually happens after a few minutes. Our algorithm runs in realtime. It was tested on a variety of real-life crowded scenes. A ground-truth was extracted for these scenes, with respect to which detection and false-alarm rates are reported.

[1] 555 M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri, “Actions as Space-Time Shapes,” Proc. IEEE Int'l Conf. Computer Vision, 2005.[2] A. Bobick and J. Davis, “The Recognition of Human Movement Using Temporal Templates,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 3, Mar. 2001.[3] O. Boiman and M. Irani, “Detecting Irregularities in Images and in Video,” Proc. IEEE Int'l Conf. Computer Vision, 2005.[4] C. Bregler, “Learning and Recognizing Human Dynamics in Video Sequences,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1997.[5] O. Chomat and J. Crowley, “Probabilistic Recognition of Activity Using Local Appearance,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1999.[6] A. Chowdhury and R. Chellappa, “A Factorization Approach for Activity Recognition,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.[7] H. Dee and D. Hogg, “Detecting Inexplicable Behaviour,” Proc. British Machine Vision Conf., 2004.[8] H. Dee and D. Hogg, “Is It interesting? Comparing Human and Machine Judgements on the Pets Dataset,” Proc. Performance and Evaluation of Tracking Systems, 2004.[9] A. Efros, A. Berg, G. Mori, and J. Malik, “Recognizing Action at a Distance,” Proc. IEEE Int'l Conf. Computer Vision, 2003.[10] A. Galata, A.A. Cohn, D. Magee, and D. Hogg, “Modeling Interaction Using Learnt Qualitative Spatio-Temporal Relations and Variable Length Markov Models,” Proc. European Conf. Artificial Intelligence, 2002.[11] A. Galata, N. Johnson, and D. Hogg, “Learning Behaviour Models of Human Activity,” Proc. British Machine Vision Conf., 1999.[12] R. Hamid, A. Johnson, S. Batta, A. Bobick, C. Isbell, and G. Coleman, “Detection and Explanation of Anomalous Activites: Representing Activities as Bags of Event N-Grams,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.[13] W. Hu, X. Xiao, Z. Fu, D. Xie, T. Tan, and S. Maybank, “A System for Learning Statistical Motion Patterns,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 9, pp. 1450-1464, Sept. 2006.[14] Y. Ivanov and A. Bobick, “Recognition of Visual Activities and Interactions by Stochastic Parsing,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, Aug. 2000.[15] N. Johnson and D. Hogg, “Learning the Distribution of Object Trajectories for Event Recognition,” Image and Vision Computing, vol. 14, no. 8, pp. 609-615, 1996.[16] Y. Ke, R. Sukthankar, and M. Hebert, “Efficient Visual Event Detection Using Volumetric Features,” Proc. IEEE Int'l Conf. Computer Vision, 2005.[17] D. Makris and T. Ellis, “Spatial and Probabilistic Modelling of Pedestrian Behaviour,” Proc. British Machine Vision Conf., 2002.[18] G. Medioni, I. Cohen, F. Bremond, S. Hongeng, and R. Nevatia, “Event Detection and Analysis from Video Streams,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 8, pp. 873-889, Aug. 2001.[19] R. Morris and D. Hogg, “Statistical Models of Object Interaction,” Int'l J.Computer Vision, vol. 37, no. 2, pp. 209-215, 2000.[20] R. Nevatia, T.T. Zhao, and S. Hongeng, “Hierarchical Language-Based Representation of Events in Video Streams,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.[21] V. Parameswaran and R. Chellappa, “View Invariants for Human Action Recognition,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.[22] F. Porkili and T. Haga, “Event Detection by Eigenvector Decomposition Using Object and Frame Features,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004.[23] C. Rao, A. Yilmaz, and M. Shah, “View Invariant Representation and Recognition of Events,” Int'l J. Computer Vision, vol. 50, no. 2, 2002.[24] N. Robertson and I. Reid, “Behaviour Understanding in Video: A Combined Method,” Proc. IEEE Int'l Conf. Computer Vision, 2005.[25] Y. Rosenberg and M. Werman, “Representing Local Motion as a Probability Distribution Matrix and Object Tracking,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1997.[26] J. Shi and J. Malik, “Motion Segmentation and Tracking Using Normalized Cuts,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1998.[27] J. Shi and C. Tomasi, “Good Features to Track,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 593-600, 1994.[28] P. Smith, N. Lobo, and M. Shah, “Temporalboost for Event Recognition,” Proc. IEEE Int'l Conf. Computer Vision, 2005.[29] T. Starner and A. Pentland, “Visual Recognition of American Sign Language Using Hidden Markov Models,” Proc. Int'l Workshop Automatic Face and Gesture Recognition, 1995.[30] C. Stauffer and W. Grimson, “Learning Patterns of Activity Using Real-Time Tracking,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 747-758, Aug. 2000.[31] N. Vaswani, A. Chowdhury, and R. Chellappa, “Activity Recognition Using the Dynamics of the Configuration of Interacting Objects,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.[32] T. Xiang and S. Gong, “Video Behaviour Profiling and Abnormality Detection without Manual Labelling,” Proc. IEEE Int'l Conf. Computer Vision, 2005.[33] T. Xiang and S. Gong, “Beyond Tracking: Modelling Activity and Understanding Behaviour,” Int'l J. Computer Vision, vol. 67, no. 1, pp. 21-51, 2006.[34] L. Zelnik-Manor and M. Irani, “Event-Based Analysis of Video,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001.[35] H. Zhong, J. Shi, and M. Visontai, “Detecting Unusual Activity in Video,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004.

Index Terms:
Video analysis, Computer vision
Citation:
Amit Adam, Ehud Rivlin, Ilan Shimshoni, David Reinitz, "Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 3, pp. 555-560, Mar. 2008, doi:10.1109/TPAMI.2007.70825
Usage of this product signifies your acceptance of the Terms of Use.