The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.02 - February (2008 vol.30)
pp: 354-360
ABSTRACT
This paper presents a novel and robust approach to consistent labeling for people surveillance in multi-camera systems. A general framework scalable to any number of cameras with overlapped views is devised. An off-line training process automatically computes ground-plane homography and recovers epipolar geometry. When a new object is detected in any one camera, hypotheses for potential matching objects in the other cameras are established. Each of the hypotheses is evaluated using a prior and likelihood value. The prior accounts for the positions of the potential matching objects, while the likelihood is computed by warping the vertical axis of the new object on the field of view of the other cameras and measuring the amount of match. In the likelihood, two contributions (forward and backward) are considered so as to correctly handle the case of groups of people merged into single objects. Eventually, a maximum-a-posteriori approach estimates the best label assignment for the new object. Comparisons with other methods based on homography and extensive outdoor experiments demonstrate that the proposed approach is accurate and robust in coping with segmentation errors and in disambiguating groups.
INDEX TERMS
Tracking, Computer vision, Motion
CITATION
Simone Calderara, Rita Cucchiara, Andrea Prati, "Bayesian-Competitive Consistent Labeling for People Surveillance", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.30, no. 2, pp. 354-360, February 2008, doi:10.1109/TPAMI.2007.70814
REFERENCES
[1] C. Brauer-Burchardt and K. Voss, “Robust Vanishing Point Determination in Noisy Images,” Proc. Int'l Conf. Pattern Recognition, vol. 1, pp. 559-562, 2000.
[2] S. Calderara, R. Vezzani, A. Prati, and R. Cucchiara, “Entry Edge of Field of View for Multi-Camera Tracking in Distributed Video Surveillance,” Proc. IEEE Int'l Conf. Advanced Video and Signal-Based Surveillance, pp. 93-98, 2005.
[3] S. Chang and T.-H. Gong, “Tracking Multiple People with a Multi-Camera System,” Proc. IEEE Workshop Multi-Object Tracking, pp. 19-26, 2001.
[4] R. Cucchiara, C. Grana, M. Piccardi, and A. Prati, “Detecting Moving Objects, Ghosts and Shadows in Video Streams,” IEEE Trans. Pattern Anaylsis and Machine Intelligence, vol. 25, no. 10, pp. 1337-1342, Oct. 2003.
[5] R. Cucchiara, C. Grana, G. Tardini, and R. Vezzani, “Probabilistic People Tracking for Occlusion Handling,” Proc. Int'l Conf. Pattern Recognition, vol. 1, pp. 132-135, Aug. 2004.
[6] S. Dockstader and A. Tekalp, “Multiple Camera Tracking of Interacting and Occluded Human Motion,” Proc. IEEE, vol. 89, no. 10, pp. 1441-1455, Oct. 2001.
[7] M.A. Fischler and R.C. Bolles, “Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography,” Comm. ACM, vol. 24, pp. 381-395, 1981.
[8] I. Haritaoglu, D. Harwood, and L. Davis, “W4: Real-Time Surveillance of People and Their Activities,” IEEE Trans. Pattern Anaylsis and Machine Intelligence, vol. 22, no. 8, pp. 809-830, Aug. 2000.
[9] T. Huang and S.J. Russell, “Object Identification in a Bayesian Context,” Proc Int'l Joint Conf. Artificial Intelligence, pp. 1276-1283, 1997.
[10] O. Javed, Z. Rasheed, K. Shafique, and M. Shah, “Tracking across Multiple Cameras with Disjoint Views,” Proc. IEEE Int'l Conf. Computer Vision, vol. 2, pp. 952-957, 2003.
[11] L. Jiang, C.S. Chua, and Y.K. Ho, “Color Based Multiple People Tracking,” Proc. IEEE Int'l Conf. Control, Automation, Robotics, and Vision, vol. 1, pp. 309-314, 2002.
[12] J. Kang, I. Cohen, and G. Medioni, “Continuous Tracking within and across Camera Streams,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 1, pp. I-267-I-272, 2003.
[13] J. Kang, I. Cohen, and G. Medioni, “Object Reacquisition Using Invariant Appearance Model,” Proc. Int'l Conf. Pattern Recognition, vol. 4, pp. 759-762, Aug. 2004.
[14] V. Kettnaker and R. Zabih, “Bayesian Multi-Camera Surveillance,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 253-259, June 1999.
[15] S. Khan and M. Shah, “Consistent Labeling of Tracked Objects in Multiple Cameras with Overlapping Fields of View,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 10, pp. 1355-1360, Oct. 2003.
[16] J. Krumm, S. Harris, B. Meyers, B. Brumitt, M. Hale, and S. Shafer, “Multi-Camera Multi-Person Tracking for Easyliving,” Proc. IEEE Int'l Workshop Visual Surveillance, pp. 3-10, 2000.
[17] Q.T. Luong, R. Deriche, O. Faugeras, and T. Papadopoulo, “On Determining the Fundamental Matrix: Analysis of Different Methods and Experimental Result,” technical report, RR, INRIA, 1993.
[18] F. Lv, T. Zhao, and R. Nevatia, “Self-Calibration of a Camera from Video of a Walking Human,” Proc. Int'l Conf. Pattern Recognition, vol. 1, pp. 562-567, Aug. 2002.
[19] A. Mittal and L. Davis, “M2tracker: A Multi-View Approach to Segmenting and Tracking People in a Cluttered Scene,” Int'l J. Computer Vision, vol. 51, no. 3, pp. 189-203, Feb. 2003.
[20] W. Niu, J. Long, D. Han, and J. Wang, “Human Activity Detection and Recognition for Video Surveillance,” Proc. IEEE Int'l Conf. Multimedia and Expo, vol. 1, pp. 719-722, June 2004.
[21] K. Nummiaro, E. Koller-Meier, T. Svoboda, D. Roth, and L. Van Gool, “Color-Based Object Tracking in Multi-Camera Environments,” Proc. 25th DAGM Symp. Pattern Recognition, pp. 591-599, 2003.
[22] J. Orwell, P. Remagnino, and G. Jones, “Multi-Camera Colour Tracking,” Proc. Second IEEE Workshop Visual Surveillance, pp. 14-21, June 1999.
[23] H. Pasula, S.J. Russell, M. Ostland, and Y. Ritov, “Tracking Many Objects with Many Sensors,” Proc. Int'l Joint Conf. Artificial Intelligence, pp. 1160-1171, 1999.
[24] C. Stauffer and K. Tieu, “Automated Multi-Camera Planar Tracking Correspondence Modeling,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 259-266, June 2003.
[25] G. Stein, “Tracking from Multiple View Points: Self-Calibration of Space and Time,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 521-527, June 1999.
[26] M.H. Tan and S. Ranganath, “Multi-Camera People Tracking Using Bayesian Networks,” Proc. 2003 Joint Conf. Fourth Int'l Conf. Information, Communications, and Signal Processing, vol. 3, pp. 1335-1340, 2003.
[27] Z. Yue, S. Zhou, and R. Chellappa, “Robust Two-Camera Tracking Using Homography,” Proc. IEEE Int'l Conf. Acoustics, Speech, and Signal Processing, vol. 3, pp. 1-4, 2004.
[28] Q. Zhou and J. Aggarwal, “Object Tracking in an Outdoor Environment Using Fusion of Features and Cameras,” Image and Vision Computing, vol. 24, no. 11, pp. 1244-1255, Nov. 2006.
7 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool