The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.09 - Sept. (2012 vol.34)
pp: 1799-1813
C. C. Loy , Sch. of Electr. Eng. & Comput. Sci., Queen Mary Univ. of London, London, UK
Tao Xiang , Sch. of Electr. Eng. & Comput. Sci., Queen Mary Univ. of London, London, UK
Shaogang Gong , Sch. of Electr. Eng. & Comput. Sci., Queen Mary Univ. of London, London, UK
ABSTRACT
Activity modeling and unusual event detection in a network of cameras is challenging, particularly when the camera views are not overlapped. We show that it is possible to detect unusual events in multiple disjoint cameras as context-incoherent patterns through incremental learning of time delayed dependencies between distributed local activities observed within and across camera views. Specifically, we model multicamera activities using a Time Delayed Probabilistic Graphical Model (TD-PGM) with different nodes representing activities in different decomposed regions from different views and the directed links between nodes encoding their time delayed dependencies. To deal with visual context changes, we formulate a novel incremental learning method for modeling time delayed dependencies that change over time. We validate the effectiveness of the proposed approach using a synthetic data set and videos captured from a camera network installed at a busy underground station.
INDEX TERMS
video surveillance, computer graphics, delays, image sensors, learning (artificial intelligence), probability, video cameras, underground station, incremental activity modeling, multiple disjoint camera views, unusual event detection, camera networks, context-incoherent patterns, time delayed dependencies, distributed local activities, multicamera activity model, time delayed probabilistic graphical model, TD-PGM, decomposed regions, directed links, visual context changes, incremental learning method, synthetic data set, video capturing, Cameras, Delay effects, Visualization, Context, Videos, Complexity theory, Member and Geographic Activities, incremental structure learning., Unusual event detection, multicamera activity modeling, time delay estimation
CITATION
C. C. Loy, Tao Xiang, Shaogang Gong, "Incremental Activity Modeling in Multiple Disjoint Cameras", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.34, no. 9, pp. 1799-1813, Sept. 2012, doi:10.1109/TPAMI.2011.246
REFERENCES
[1] T. Xiang and S. Gong, "Video Behavior Profiling for Anomaly Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 5, pp. 893-908, May 2008.
[2] J. Kim and K. Grauman, "Observe Locally, Infer Globally: A Space-Time MRF for Detecting Abnormal Activities with Incremental Updates," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2921-2928, 2009.
[3] T. Hospedales, S. Gong, and T. Xiang, "A Markov Clustering Topic Model for Mining Behaviour in Video," Proc. IEEE Int'l Conf. Computer Vision, pp. 1165-1172, 2009.
[4] D. Kuettel, M.D. Breitenstein, L.V. Gool, and V. Ferrari, "What's Going On? Discovering Spatio-Temporal Dependencies in Dynamic Scenes," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1951-1958, 2010.
[5] T. Xiang and S. Gong, "Incremental and Adaptive Abnormal Behaviour Detection," Computer Vision and Image Understanding, vol. 111, no. 1, pp. 59-73, 2008.
[6] E.E. Zelniker, S. Gong, and T. Xiang, "Global Abnormal Behaviour Detection Using a Network of CCTV Cameras," Proc. IEEE Int'l Workshop Visual Surveillance, 2008.
[7] D. Makris, T. Ellis, and J. Black, "Bridging the Gaps between Cameras," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 205-210, 2004.
[8] K. Tieu, G. Dalley, and W.E.L. Grimson, "Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence," Proc. IEEE Int'l Conf. Computer Vision, pp. 1842-1849, 2005.
[9] O. Javed, K. Shafique, and M. Shah, "Appearance Modeling for Tracking in Multiple Non-Overlapping Cameras," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 26-33, 2005.
[10] X. Wang, K. Tieu, and W.E.L. Grimson, "Correspondence-Free Activity Analysis and Scene Modeling in Multiple Camera Views," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 1, pp. 56-71, Jan. 2010.
[11] H. Zhou and D. Kimber, "Unusual Event Detection via Multi-Camera Video Mining," Proc. IEEE Int'l Conf. Pattern Recognition, pp. 1161-1166, 2006.
[12] P. Spirtes, C. Glymour, and R. Scheines, Causation, Prediction, and Search, second ed. The MIT Press, 2000.
[13] G.F. Cooper, "A Simple Constraint-Based Algorithm for Efficiently Mining Observational Databases for Causal Relationships," Data Mining and Knowledge Discovery, vol. 1, no. 2, pp. 203-224, 1997.
[14] G.F. Cooper and E. Herskovits, "A Bayesian Method for the Induction of Probabilistic Networks from Data," Machine Learning, vol. 9, no. 4, pp. 309-347, 1992.
[15] D. Heckerman, D. Geiger, and D.M. Chickering, "Learning Bayesian Networks: The Combination of Knowledge and Statistical Data," Machine Learning, vol. 20, no. 3, pp. 197-243, 1995.
[16] I. Tsamardinos, L.E. Brown, and C.F. Aliferis, "The Max-Min Hill-Climbing Bayesian Network Structure Learning Algorithm," Machine Learning, vol. 65, no. 1, pp. 31-78, 2006.
[17] X. Chen, G. Anantha, and X. Lin, "Improving Bayesian Network Structure Learning with Mutual Information-Based Node Ordering in the K2 Algorithm," IEEE Trans. Knowledge and Data Eng., vol. 20, no. 5, pp. 628-640, May 2008.
[18] N. Friedman and M. Goldszmidt, "Sequential Update of Bayesian Network Structure," Proc. 13th Conf. Uncertainty in Artificial Intelligence, pp. 165-174, 1997.
[19] S.H. Nielsen and T.D. Nielsen, "Adapting Bayes Network Structures to Non-Stationary Domains," Int'l J. Approximate Reasoning, vol. 49, no. 2, pp. 379-397, 2008.
[20] D.M. Chickering, D. Geiger, and D. Heckerman, "Learning Bayesian Networks: Search Methods and Experimental Results," Proc. Int'l Workshop Artificial Intelligence and Statistics, pp. 112-128, 1995.
[21] N. Friedman, I. Nachman, and D. Peér, "Learning Bayesian Network Structure from Massive Datasets: The Sparse Candidate Algorithm," Proc. 15th Conf. Uncertainty in Artificial Intelligence, pp. 206-215, 1999.
[22] C.C. Loy, T. Xiang, and S. Gong, "Modelling Activity Global Temporal Dependencies Using Time Delayed Probabilistic Graphical Model," Proc. IEEE Int'l Conf. Computer Vision, pp. 120-127, 2009.
[23] C.C. Loy, T. Xiang, and S. Gong, "Time-Delayed Correlation Analysis for Multi-Camera Activity Understanding," Int'l J. Computer Vision, vol. 90, no. 1, pp. 106-129, 2010.
[24] L. Zelnik-Manor and P. Perona, "Self-Tuning Spectral Clustering," Proc. 18th Ann. Conf. Advances in Neural Information Processing Systems, pp. 1601-1608, 2004.
[25] X. Wang, X. Ma, and W.E.L. Grimson, "Unsupervised Activity Perception in Crowded and Complicated Scenes using Hierarchical Bayesian Models," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 3, pp. 539-555, Mar. 2009.
[26] Y. Yang, J. Liu, and M. Shah, "Video Scene Understanding Using Multi-Scale Analysis," Proc. IEEE Int'l Conf. Computer Vision, 2009.
[27] L. Kratz and K. Nishino, "Anomaly Detection in Extremely Crowded Scenes Using Spatio-Temporal Motion Pattern Models," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1446-1453, 2009.
[28] A.M. Fraser and H.L. Swinney, "Independent Coordinates for Strange Attractors from Mutual Information," Physical Rev., vol. 33, no. 2, pp. 1134-1140, 1986.
[29] C. Chow and C. Liu, "Approximating Discrete Probability Distributions with Dependence Trees," IEEE Trans. Information Theory, vol. 14, no. 3, pp. 462-467, May 1968.
[30] R.C. Prim, "Shortest Connection Networks and Some Generalizations," Bell System Technical J., vol. 36, pp. 1389-1401, 1957.
[31] X. Chen, G. Anantha, and X. Wang, "An Effective Structure Learning Method for Constructing Gene Networks," Bioinformatics, vol. 22, no. 11, pp. 1367-1374, 2006.
[32] T.H. Cormen, C.E. Leiserson, R.L. Rivest, and C. Stein, Introduction to Algorithms, third ed. The MIT Press, 2009.
[33] G. Schwarz, "Estimating the Dimension of a Model," The Annals of Math. Statistics, vol. 6, no. 2, pp. 461-464, 1978.
[34] N. Friedman and D. Koller, "Being Bayesian about Network Structure," Proc. 16th Conf. Uncertainty in Artificial Intelligence, pp. 201-210, 2000.
[35] C.P. de Campos, Z. Zeng, and Q. Ji, "Structure Learning of Bayesian Networks Using Constraints," Proc. Int'l Conf. Machine Learning, pp. 113-120, 2009.
[36] C. Auliac, V. Frouin, X. Gidrol, and F. díAlch Buc, "Evolutionary Approaches for the Reverse-Engineering of Gene Regulatory Networks: A Study on a Biologically Realistic Dataset," BMC Bioinformatics, vol. 9, pp. 1-14, 2008.
[37] K.P. Murphy, "Active Learning of Causal Bayes Net Structure," technical report, Univ. of California, 2001.
[38] Markov Chain Monte Carlo in Practice, W. Gilks, S. Richardson and D. Spiegelhalter, eds., first ed. Chapman and Hall, 1995.
[39] W. Lam and F. Bacchus, "Using New Data to Refine a Bayesian Network," Proc. 10th Conf. Uncertainty in Artificial Intelligence, 1994.
[40] D. Eaton and K. Murphy, "Bayesian Structure Learning Using Dynamic Programming and MCMC," Proc. 23rd Conf. Uncertainty in Artificial Intelligence, pp. 101-108, 2007.
[41] K. Prabhakar, S. Oh, P. Wang, G.D. Abowd, and J.M. Rehg, "Temporal Causality for the Analysis of Visual Events," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
114 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool