The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.10 - Oct. (2012 vol.34)
pp: 2064-2070
Berkan Solmaz , University of Central Florida, Orlando
Brian E. Moore , University of Central Florida, Orlando
Mubarak Shah , University of Central Florida, Orlando
ABSTRACT
A method is proposed for identifying five crowd behaviors (bottlenecks, fountainheads, lanes, arches, and blocking) in visual scenes. In the algorithm, a scene is overlaid by a grid of particles initializing a dynamical system defined by the optical flow. Time integration of the dynamical system provides particle trajectories that represent the motion in the scene; these trajectories are used to locate regions of interest in the scene. Linear approximation of the dynamical system provides behavior classification through the Jacobian matrix; the eigenvalues determine the dynamic stability of points in the flow and each type of stability corresponds to one of the five crowd behaviors. The eigenvalues are only considered in the regions of interest, consistent with the linear approximation and the implicated behaviors. The algorithm is repeated over sequential clips of a video in order to record changes in eigenvalues, which may imply changes in behavior. The method was tested on over 60 crowd and traffic videos.
INDEX TERMS
Trajectory, Eigenvalues and eigenfunctions, Jacobian matrices, Tracking, Stability analysis, Algorithm design and analysis, Scene analysis, crowd behaviors., Video scene analysis, dynamical systems
CITATION
Berkan Solmaz, Brian E. Moore, Mubarak Shah, "Identifying Behaviors in Crowd Scenes Using Stability Analysis for Dynamical Systems", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.34, no. 10, pp. 2064-2070, Oct. 2012, doi:10.1109/TPAMI.2012.123
REFERENCES
[1] L. Kratz and K. Nishino, "Anomaly Detection in Extremely Crowded Scenes Using Spatio-Temporal Motion Pattern Models," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[2] H. Zhong, J. Shi, and M. Visontai, "Detecting Unusual Activity in Video," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2004.
[3] V. Mahadevan, W. Li, V. Bhalodia, and N. Vasconcelos, "Anomaly Detection in Crowded Scenes," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[4] S. Wu, B.E. Moore, and M. Shah, "Chaotic Invariants of Lagrangian Particle Trajectories for Anomaly Detection in Crowded Scenes," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[5] G. Brostow and R. Cipolla, "Unsupervised Bayesian Detection of Independent Motion in Crowds," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2006.
[6] L. Kratz and K. Nishino, "Tracking with Local Spatio-Temporal Motion Patterns in Extremely Crowded Scenes," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[7] S. Ali and M. Shah, "Floor Fields for Tracking in High Density Crowd Scenes," Proc. 10th European Conf. Computer Vision, pp. 1-14, 2008.
[8] S. Pellegrini, A. Ess, K. Schindler, and L. Van Gool, "You'll Never Walk Alone: Modeling Social Behavior for Multi-Target Tracking," Proc. 12th IEEE Int'l Conf. Computer Vision, 2009.
[9] T. Zhao and R. Nevatia, "Tracking Multiple Humans in Crowded Environment," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2004.
[10] V. Rabaud and S. Belongie, "Counting Crowded Moving Objects," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2006.
[11] D. Yang, H. Gonzalez-Banos, and L. Guibas, "Counting People in Crowds with a Real-Time Network of Simple Image Sensors," Proc. Ninth IEEE Int'l Conf. Computer Vision, vol. 1, pp. 122-129, 2003.
[12] A. Chan and N. Vasconcelos, "Bayesian Poisson Regression for Crowd Counting," Proc. 12th IEEE Int'l Conf. Computer Vision, pp. 545-551, Sept. 2009.
[13] A.B. Chan and N. Vasconcelos, "Mixtures of Dynamic Textures," Proc. 10th IEEE Int'l Conf. Computer Vision, vol. 1, pp. 641-647, 2005.
[14] P. Sand and S. Teller, "Particle Video: Long-Range Motion Estimation Using Point Trajectories," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2006.
[15] P. Tu, T. Sebastian, G. Doretto, N. Krahnstoever, J. Rittscher, and T. Yu, "Unified Crowd Segmentation," Proc. 10th European Conf. Computer Vision, 2008.
[16] J. Wright and R. Pless, "Analysis of Persistent Motion Patterns Using the 3D Structure Tensor," Proc. IEEE Seventh Workshop Motion and Video Computing, vol. 2, pp. 14-19, Jan. 2005.
[17] R. Pini, M. Ofer, A. Shai, and S. Amnon, "Crowd Detection in Video Sequences," Proc. IEEE Intelligent Vehicles Symp, pp. 66-71, 2004.
[18] B. Zhan, D.N. Monekosso, P. Remagnino, S.A. Velastin, and L.-Q. Xu, "Crowd Analysis: A Survey," Machine Vision Applications, vol. 19, nos. 5/6, pp. 345-357, 2008.
[19] C. Stauffer and W. Grimson, "Learning Patterns of Activity Using Real-Time Tracking," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 747-757, Aug. 2000.
[20] P. Viola, M. Jones, and D. Snow, "Detecting Pedestrians Using Patterns of Motion and Appearance," Proc. Ninth IEEE Int'l Conf. Computer Vision, vol. 2, pp. 734-741, 2003.
[21] J.S. Marques, P.M. Jorge, A.J. Abrantes, and J.M. Lemos, "Tracking Groups of Pedestrians in Video Sequences," Proc. IEEE Computer Vision and Pattern Recognition Workshop, vol. 9, p. 101, 2003.
[22] N. Johnson and D. Hogg, "Learning the Distribution of Object Trajectories for Event Recognition," Proc. Sixth British Conf. Machine Vision, pp. 583-592, 1995.
[23] R. Li and R. Chellappa, "Group Motion Segmentation Using a Spatio-Temporal Driving Force Model," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[24] E.L. Andrade, S. Blunsden, and R.B. Fisher, "Modelling Crowd Scenes for Event Detection," Proc. 18th Int'l Conf. Pattern Recognition, pp. 175-178, 2006.
[25] M. Pittore, M. Campani, and A. Verri, "Learning to Recognize Visual Dynamic Events from Examples," Int'l J. Computer Vision, vol. 38, no. 1, pp. 35-44, 2000.
[26] I. Laptev, "On Space-Time Interest Points," Int'l J. Computer Vision, vol. 64, nos. 2/3, pp. 107-123, 2005.
[27] S. Ali and M. Shah, "A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2007.
[28] G. Haller and G. Yuan, "Lagrangian Coherent Structures and Mixing in Two-Dimensional Turbulence," Physica D, vol. 147, nos. 3/4, pp. 352-370, 2000.
[29] R.L. Hughes, "A Continuum Theory for the Flow of Pedestrians," Transportation Research Part B: Methodological, vol. 36, no. 6, pp. 507-535, 2002.
[30] R. Mehran, A. Oyama, and M. Shah, "Abnormal Crowd Behavior Detection Using Social Force Model," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 935-942, 2009.
[31] M. Hu, S. Ali, and M. Shah, "Learning Motion Patterns in Crowded Scenes Using Motion Flow Field," Proc. Int'l Conf. Pattern Recognition, 2008.
[32] P. Widhalm and N. Brandle, "Learning Major Pedestrian Flows in Crowded Scenes," Proc. Int'l Conf. Pattern Recognition, 2010.
[33] A.R. Rao and R.C. Jain, "Computerized Flow Field Analysis: Oriented Texture Fields," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 7, pp. 693-709, July 1992.
[34] R. Ford, "Critical Point Detection in Fluid Flow Images Using Dynamical System Properties," Pattern Recognition, vol. 30, no. 12, pp. 1991-2000, 1997.
[35] D. Helbing, "A Fluid Dynamic Model for the Movement of Pedestrians," Complex Systems, vol. 6, pp. 391-415, May 1992.
[36] A. Okubo, "Horizontal Dispersion of Floatable Trajectories in the Vicinity of Velocity Singularities Such As Convergencies," Deep Sea Research, vol. 17, pp. 445-454, 1970.
[37] S.H. Strogatz, Nonlinear Dynamics and Chaos: With Applications to Physics, Biology, Chemistry, and Engineering. Addison-Wesley, 1994.
[38] B.D. Lucas and T. Kanade, "An Iterative Image Registration Technique with an Application to Stereo Vision," Proc. Seventh Int'l Joint Conf. Artificial Intelligence, pp. 674-679, 1981.
[39] K. Fukunaga and L. Hostetler, "The Estimation of the Gradient of a Density Function, with Applications In Pattern Recognition," IEEE Trans. Information Theory, vol. 21, no. 1, pp. 32-40, Jan. 1975.
[40] M. Everingham, L. Van Gool, C.K.I. Williams, J. Winn, and A. Zisserman, "The PASCAL Visual Object Classes (VOC) Challenge," Int'l J. Computer Vision, vol. 88, no. 2, pp. 303-338, 2010.
396 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool