The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.04 - April (2010 vol.32)
pp: 709-721
Roman Pflugfelder , Austrian Research Centers - ARC , Vienna
ABSTRACT
This paper proposes a method that localizes two surveillance cameras and simultaneously reconstructs object trajectories in 3D space. The method is an extension of the Direct Reference Plane method, which formulates the localization and the reconstruction as a system of linear equations that is globally solvable by Singular Value Decomposition. The method's assumptions are static synchronized cameras, smooth trajectories, known camera internal parameters, and the rotation between the cameras in a world coordinate system. The paper describes the method in the context of self-calibrating cameras, where the internal parameters and the rotation can be jointly obtained assuming a man-made scene with orthogonal structures. Experiments with synthetic and real--image data show that the method can recover the camera centers with an error less than half a meter even in the presence of a 4 meter gap between the fields of view.
INDEX TERMS
Camera localization, nonoverlapping camera views, direct reference plane method, simultaneous localization and tracking.
CITATION
Roman Pflugfelder, "Localization and Trajectory Reconstruction in Surveillance Cameras with Nonoverlapping Views", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.32, no. 4, pp. 709-721, April 2010, doi:10.1109/TPAMI.2009.56
REFERENCES
[1] R. Pflugfelder and H. Bischof, "People Tracking across Two Distant Self-Calibrated Cameras," Proc. IEEE Int'l Conf. Advanced Video and Signal Based Surveillance, Sept. 2007.
[2] R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge Univ. Press, 2004.
[3] M. Shah, O. Javed, and K. Shafique, "Automated Visual Surveillance in Realistic Scenarios," IEEE Multimedia, vol. 14, no. 1, pp. 30-39, Jan.-Mar. 2007.
[4] T. Svoboda, D. Martinec, and T. Pajdla, "A Convinient Multi-Camera Self-Calibration for Virtual Environments," Presence: Teleoperators and Virtual Environments, vol. 14, no. 4, pp. 407-422, 2005.
[5] C. Rother, "Multi-View Reconstruction and Camera Recovery Using a Real and Virtual Reference Plane," PhD dissertation, Royal Inst. of Tech nology, Jan. 2003.
[6] J.M. Coughlan and A.L. Yuille, "Manhattan World: Compass Direction from a Single Image by Bayesian Inference," Proc. Int'l Conf. Computer Vision, vol. 2, pp. 941-947, Sept. 1999.
[7] D. Liebowitz and A. Zisserman, "Combining Scene and Auto-Calibration Constraints," Proc. Int'l Conf. Computer Vision, vol. 1, pp. 293-300, Sept. 1999.
[8] D. Devarajan, Z. Cheng, and R. Radke, "Calibrating Distributed Camera Networks," Proc. IEEE, vol. 96, no. 10, pp. 1625-1639, Oct. 2008.
[9] A. Rahimi, B. Dunagan, and T. Darrell, "Simultaneous Calibration and Tracking of Non-Overlapping Sensors," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, June 2004.
[10] C. Taylor, A. Rahimi, J. Bachrach, H. Shrobe, and A. Grue, "Simultaneous Localization, Calibration, and Tracking in an Ad Hoc Sensor Network," Proc. Fifth Int'l Conf. Information Processing in Sensor Networks, pp. 27-33, 2006.
[11] D. Liebowitz, "Camera Calibration and Reconstruction of Geometry from Images," PhD dissertation, Dept. of Eng. Science, Univ. of Oxford, June 2001.
[12] R. Pflugfelder, "Self-Calibrating Cameras in Video Surveillance," PhD dissertation, Graz Univ. of Tech nology, May 2008.
[13] R. Pflugfelder and H. Bischof, "On-Line Auto-Calibration in Man-Made Worlds," Proc. Digital Image Computing: Techniques and Applications, Dec. 2005.
[14] J. Kosecka and W. Zhang, "Video Compass," Proc. Seventh European Conf. Computer Vision, p. 476f, May 2002.
[15] G. Schindler and F. Dellaert, "Atlanta World: An Expectation Maximization Framework for Simultaneous Low-Level Edge Grouping and Camera Calibration in Complex Man-Made Environments," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 203-209, 2004.
[16] R.Y. Tsai, "A Versatile Camera Calibration Technique for High-Accuracy 3d Machine Vision Metrology Using Off-the-Shelf TV Cameras and Lenses," IEEE J. Robotics and Automation, vol. 3, no. 4, pp. 323-344, Aug. 1987.
[17] Y. Caspi and M. Irani, "Aligning Non-Overlapping Sequences," Int'l J. Computer Vision, vol. 48, no. 1, pp. 39-51, 2002.
[18] O. Javed, Z. Rasheed, O. Alatas, and M. Shah, "M-knight: A Real Time Surveillance System for Multiple and Non-Overlapping Cameras," Proc. IEEE Int'l Conf. Multimedia and Expo, July 2003.
[19] R.B. Fisher, "Self-Organization of Randomly Placed Sensors," Proc. European Conf. Computer Vision, vol. 4, pp. 146-160f, 2002.
[20] N. Anjum, M. Taj, and A. Cavallaro, "Relative Position Estimation of Non-Overlapping Cameras," Proc. IEEE Int'l Conf. Acoustics, Speech, and Signal Processing, Apr. 2007.
[21] M. Rudoy and C.E. Rohrs, "Simultaneous Sensor Calibration and Path Estimation," Proc. IEEE Asilomar Conf. Signals, Systems, and Computers, 2006.
[22] C. Rother and S. Carlsson, "Multi View Reconstruction and Camera Recovery," Proc. Int'l Conf. Computer Vision, July 2001.
[23] C. Tomasi and L. Kanade, "Shape and Motion from Image Streams under Orthography: A Factorization Approach," Int'l J. Computer Vision, vol. 9, no. 2, pp. 137-154, Nov. 1992.
[24] D. Makris, T. Ellis, and J. Black, "Bridging the Gaps between Cameras," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 205-210, 2004.
[25] D. Marinakis and G. Dudek, "Self-Calibration of a Vision-Based Sensor Network," Image and Vision Computing, vol. 27, nos. 1/2, pp. 116-130, Jan. 2009.
[26] H. Li and R. Hartley, "The 3d-3d Registration Problem Revisited," Proc. 11th Int'l Conf. Computer Vision, pp. 1-8, Oct. 2007.
[27] R. Hartley and F. Kahl, "Global Optimization through Searching Rotation Space and Optimal Estimation of the Essential Matrix," Proc. Int'l Conf. Computer Vision, Oct. 2007.
[28] R. Pflugfelder and H. Bischof, "Tracking across Non-Overlapping Views via Geometry," Proc. 19th Int'l Conf. Pattern Recognition, Dec. 2008.
[29] B. Rinner and W. Wolf, "An Introduction to Distributed Smart Cameras," Proc. IEEE, vol. 96, no. 10, pp. 1565-1575, Oct. 2008.
[30] B. Triggs, P. McLauchlan, R. Hartley, and A. Fitzgibbon, Vision Algorithms: Theory and Practice, pp. 298-375. Springer, 2000.
[31] O. Chum, J. Matas, and J. Kittler, "Locally Optimized Ransac," Proc. DAGM Symp., pp. 236-243, Sept. 2003.
[32] P. Viola and M. Jones, "Robust Real-Time Object Detection," Int'l J. Computer Vision, vol. 57, no. 2, pp. 137-154, May 2004.
[33] R. Kaucic, R. Hartley, and N. Dano, "Plane-Based Projective Reconstruction," Proc. Int'l Conf. Computer Vision, vol. 1, pp. 420-427, 2001.
[34] M. Brand, "Fast Low-Rank Modifications of the Thin Singular Value Decomposition," Linear Algebra and Its Applications, vol. 415, no. 1, pp. 20-30, May 2006.
5 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool