This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors
March 2008 (vol. 30 no. 3)
pp. 555-560
We present a novel algorithm for detection of certain types of unusual events. The algorithm is based on multiple local monitors which collect low-level statistics. Each local monitor produces an alert if its current measurement is unusual, and these alerts are integrated to a final decision regarding the existence of an unusual event. Our algorithm satisfies a set of requirements that are critical for successful deployment of any large-scale surveillance system. In particular it requires a minimal setup (taking only a few minutes) and is fully automatic afterwards. Since it is not based on objects' tracks, it is robust and works well in crowded scenes where tracking-based algorithms are likely to fail. The algorithm is effective as soon as sufficeint low-level observations representing the routine activity have been collected, which usually happens after a few minutes. Our algorithm runs in realtime. It was tested on a variety of real-life crowded scenes. A ground-truth was extracted for these scenes, with respect to which detection and false-alarm rates are reported.

[1] M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri, “Actions as Space-Time Shapes,” Proc. IEEE Int'l Conf. Computer Vision, 2005.
[2] A. Bobick and J. Davis, “The Recognition of Human Movement Using Temporal Templates,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 3, Mar. 2001.
[3] O. Boiman and M. Irani, “Detecting Irregularities in Images and in Video,” Proc. IEEE Int'l Conf. Computer Vision, 2005.
[4] C. Bregler, “Learning and Recognizing Human Dynamics in Video Sequences,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1997.
[5] O. Chomat and J. Crowley, “Probabilistic Recognition of Activity Using Local Appearance,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1999.
[6] A. Chowdhury and R. Chellappa, “A Factorization Approach for Activity Recognition,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.
[7] H. Dee and D. Hogg, “Detecting Inexplicable Behaviour,” Proc. British Machine Vision Conf., 2004.
[8] H. Dee and D. Hogg, “Is It interesting? Comparing Human and Machine Judgements on the Pets Dataset,” Proc. Performance and Evaluation of Tracking Systems, 2004.
[9] A. Efros, A. Berg, G. Mori, and J. Malik, “Recognizing Action at a Distance,” Proc. IEEE Int'l Conf. Computer Vision, 2003.
[10] A. Galata, A.A. Cohn, D. Magee, and D. Hogg, “Modeling Interaction Using Learnt Qualitative Spatio-Temporal Relations and Variable Length Markov Models,” Proc. European Conf. Artificial Intelligence, 2002.
[11] A. Galata, N. Johnson, and D. Hogg, “Learning Behaviour Models of Human Activity,” Proc. British Machine Vision Conf., 1999.
[12] R. Hamid, A. Johnson, S. Batta, A. Bobick, C. Isbell, and G. Coleman, “Detection and Explanation of Anomalous Activites: Representing Activities as Bags of Event N-Grams,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
[13] W. Hu, X. Xiao, Z. Fu, D. Xie, T. Tan, and S. Maybank, “A System for Learning Statistical Motion Patterns,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 9, pp. 1450-1464, Sept. 2006.
[14] Y. Ivanov and A. Bobick, “Recognition of Visual Activities and Interactions by Stochastic Parsing,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, Aug. 2000.
[15] N. Johnson and D. Hogg, “Learning the Distribution of Object Trajectories for Event Recognition,” Image and Vision Computing, vol. 14, no. 8, pp. 609-615, 1996.
[16] Y. Ke, R. Sukthankar, and M. Hebert, “Efficient Visual Event Detection Using Volumetric Features,” Proc. IEEE Int'l Conf. Computer Vision, 2005.
[17] D. Makris and T. Ellis, “Spatial and Probabilistic Modelling of Pedestrian Behaviour,” Proc. British Machine Vision Conf., 2002.
[18] G. Medioni, I. Cohen, F. Bremond, S. Hongeng, and R. Nevatia, “Event Detection and Analysis from Video Streams,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 8, pp. 873-889, Aug. 2001.
[19] R. Morris and D. Hogg, “Statistical Models of Object Interaction,” Int'l J.Computer Vision, vol. 37, no. 2, pp. 209-215, 2000.
[20] R. Nevatia, T.T. Zhao, and S. Hongeng, “Hierarchical Language-Based Representation of Events in Video Streams,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.
[21] V. Parameswaran and R. Chellappa, “View Invariants for Human Action Recognition,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.
[22] F. Porkili and T. Haga, “Event Detection by Eigenvector Decomposition Using Object and Frame Features,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004.
[23] C. Rao, A. Yilmaz, and M. Shah, “View Invariant Representation and Recognition of Events,” Int'l J. Computer Vision, vol. 50, no. 2, 2002.
[24] N. Robertson and I. Reid, “Behaviour Understanding in Video: A Combined Method,” Proc. IEEE Int'l Conf. Computer Vision, 2005.
[25] Y. Rosenberg and M. Werman, “Representing Local Motion as a Probability Distribution Matrix and Object Tracking,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1997.
[26] J. Shi and J. Malik, “Motion Segmentation and Tracking Using Normalized Cuts,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1998.
[27] J. Shi and C. Tomasi, “Good Features to Track,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 593-600, 1994.
[28] P. Smith, N. Lobo, and M. Shah, “Temporalboost for Event Recognition,” Proc. IEEE Int'l Conf. Computer Vision, 2005.
[29] T. Starner and A. Pentland, “Visual Recognition of American Sign Language Using Hidden Markov Models,” Proc. Int'l Workshop Automatic Face and Gesture Recognition, 1995.
[30] C. Stauffer and W. Grimson, “Learning Patterns of Activity Using Real-Time Tracking,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 747-758, Aug. 2000.
[31] N. Vaswani, A. Chowdhury, and R. Chellappa, “Activity Recognition Using the Dynamics of the Configuration of Interacting Objects,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.
[32] T. Xiang and S. Gong, “Video Behaviour Profiling and Abnormality Detection without Manual Labelling,” Proc. IEEE Int'l Conf. Computer Vision, 2005.
[33] T. Xiang and S. Gong, “Beyond Tracking: Modelling Activity and Understanding Behaviour,” Int'l J. Computer Vision, vol. 67, no. 1, pp. 21-51, 2006.
[34] L. Zelnik-Manor and M. Irani, “Event-Based Analysis of Video,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001.
[35] H. Zhong, J. Shi, and M. Visontai, “Detecting Unusual Activity in Video,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004.

Index Terms:
Video analysis, Computer vision
Citation:
Amit Adam, Ehud Rivlin, Ilan Shimshoni, David Reinitz, "Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 3, pp. 555-560, March 2008, doi:10.1109/TPAMI.2007.70825
Usage of this product signifies your acceptance of the Terms of Use.