This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Consistent Labeling of Tracked Objects in Multiple Cameras with Overlapping Fields of View
October 2003 (vol. 25 no. 10)
pp. 1355-1360

Abstract—In this paper, we address the issue of tracking moving objects in an environment covered by multiple uncalibrated cameras with overlapping fields of view, typical of most surveillance setups. In such a scenario, it is essential to establish correspondence between tracks of the same object, seen in different cameras, to recover complete information about the object. We call this the problem of consistent labeling of objects when seen in multiple cameras. We employ a novel approach of finding the limits of field of view (FOV) of each camera as visible in the other cameras. We show that, if the FOV lines are known, it is possible to disambiguate between multiple possibilities for correspondence. We present a method to automatically recover these lines by observing motion in the environment. Furthermore, once these lines are initialized, the homography between the views can also be recovered. We present results on indoor and outdoor sequences containing persons and vehicles.

[1] J. Black and T. Ellis, Multiple Camera Image Tracking Proc. Performance Evaluation of Tracking and Surveillance Conf.(PETS 2001), with CVPR 2001, Dec. 2001.
[2] Q. Cai and J.K. Aggarwal, Tracking Human Motion in Structured Environments Using a Distributed Camera System IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 11, pp. 1241-1247, Nov. 1999.
[3] Y. Caspi and M. Irani, A Step Towards Sequence-to-Sequence Alignment IEEE Proc. Conf. Computer Vision and Pattern Recognition, June 2000.
[4] T.-H. Chang and S. Gong, Tracking Multiple People with a Multi-Camera System Proc. IEEE Workshop Multi-Object Tracking, with ICCV '01, July 2001.
[5] R.T. Collins, A.J. Fujiyoshi, and T. Kanade, Algorithms for Cooperative Multisensor Surveillance Proc. IEEE, vol. 89, no. 10, pp. 1456-1477, Oct. 2001.
[6] H. Fuiyoshi and A.J. Lipton, Real-Time Human Motion Analysis by Image Skeletonization Proc. Image Understanding Workshop, 1998.
[7] O. Javed, K. Shafique, and M. Shah, A Hierarchical Approach to Robust Background Subtraction Using Color and Gradient Information Proc. Workshop Motion and Video Computing, Dec. 2002.
[8] T. Kanade, R.T. Collins, A.J. Lipton, P.J. Burt, and L. Wixson, Advances in Cooperative Multi-Sensor Video Surveillance Proc. DARPA Image Understanding Workshop, pp. 3-24, 1998.
[9] P. Kelly, A. Katkere, D. Kuramura, S. Moezzi, S. Chatterjee, and R. Jain, An Architecture for Multiple Perspective Interactive Video Proc. ACM Multimedia 95, pp. 201-212, 1995.
[10] V. Kettnaker and R. Zabih, Bayesian Multi-Camera Sureveillance Proc. Computer Vision and Pattern Recognition, pp. 253-259, June 1999.
[11] L. Lee, R. Romano, and G. Stein, Monitoring Activities from Multiple Video Streams: Establishing a Common Coordinate Frame IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 758-767, Aug. 2000.
[12] H. Pasula, S. Russell, M. Ostland, and Y. Ritov, Tracking Many Objects with Many Sensors Proc. Int'l Joint Conf. Artificial Intelligence '99, 1999.
[13] C. Stauffer and W.E.L. Grimson, Learning Patterns of Activity Using Real-Time Tracking IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 747-757, Aug. 2000.
[14] T.N. Tan, G.D. Sullivan, and K.D. Baker, Recognizing Objects on the Ground Plane Image Vision Computing, vol. 12, no. 164, p. 172, Apr. 1994.
[15] H. Tao, H.S. Sawhney, and R. Kumar, Object Tracking with Bayesian Estimation of Dynamic Layer Representations IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 1, pp. 75-89, Jan. 2002.
[16] A. Utsumi and J. Ohya, Multiple-Camera-Based Human Tracking Using Non-Synchronous Observations Proc. Asian Conf. Computer Vision, pp. 1034-1039, Jan. 2000.
[17] O. Javed, Z. Rasheed, K. Shafique, and M. Shah, Tracking Across Multiple Cameras with Disjoint Views Proc. Ninth IEEE Int'l Conf. Computer Vision, 2003.
[18] S. Khan, O. Javed, and M. Shah, Tracking in Uncalibrated Cameras with Overlapping Field of View Proc. Performance Evaluation of Tracking and Surveillance PETS 2001, (with CVPR 2001), Dec. 2001.

Index Terms:
Tracking, multiple cameras, multiperspective video, surveillance, camera handoff, sensor fusion.
Citation:
Sohaib Khan, Mubarak Shah, "Consistent Labeling of Tracked Objects in Multiple Cameras with Overlapping Fields of View," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 10, pp. 1355-1360, Oct. 2003, doi:10.1109/TPAMI.2003.1233912
Usage of this product signifies your acceptance of the Terms of Use.