loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Multiple Motion Scene Reconstruction with Uncalibrated Cameras
July 2003 (vol. 25 no. 7)
pp. 884-894
ASCII Text
x 
 
Mei Han, Takeo Kanade, "Multiple Motion Scene Reconstruction with Uncalibrated Cameras," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 7, pp. 884-894, July, 2003.
 
 
BibTex
x
 
@article{ 10.1109/TPAMI.2003.1206517,
author = {Mei Han and Takeo Kanade},
title = {Multiple Motion Scene Reconstruction with Uncalibrated Cameras},
journal ={IEEE Transactions on Pattern Analysis and Machine Intelligence},
volume = {25},
number = {7},
issn = {0162-8828},
year = {2003},
pages = {884-894},
doi = {http://doi.ieeecomputersociety.org/10.1109/TPAMI.2003.1206517},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - JOUR
JO - IEEE Transactions on Pattern Analysis and Machine Intelligence
TI - Multiple Motion Scene Reconstruction with Uncalibrated Cameras
IS - 7
SN - 0162-8828
SP884
EP894
EPD - 884-894
A1 - Mei Han,
A1 - Takeo Kanade,
PY - 2003
KW - Structure from motion
KW - motion segmentation
KW - camera calibration
KW - dynamic scene reconstruction
KW - computer vision.
VL - 25
JA - IEEE Transactions on Pattern Analysis and Machine Intelligence
ER -
 

Abstract—In this paper, we describe a reconstruction method for multiple motion scenes, which are scenes containing multiple moving objects, from uncalibrated views. Assuming that the objects are moving with constant velocities, the method recovers the scene structure, the trajectories of the moving objects, the camera motion, and the camera intrinsic parameters (except skews) simultaneously. We focus on the case where the cameras have unknown and varying focal lengths while the other intrinsic parameters are known. The number of the moving objects is automatically detected without prior motion segmentation. The method is based on a unified geometrical representation of the static scene and the moving objects. It first performs a projective reconstruction using a bilinear factorization algorithm and, then, converts the projective solution to a Euclidean one by enforcing metric constraints. Experimental results on synthetic and real images are presented.

[1] L. de Agapito, R.I. Hartley, and E. Hayman, Linear Calibration of a Rotating and Zooming Camera Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 15-21, 1999.[2] S. Avidan and A. Shashua, Trajectory Triangulation of Lines: Reconstruction of a 3D Point Moving Along a Line from a Monocular Image Sequence Proc. IEEE Conf. Computer Vision and Pattern Recognition 99, 1999.[3] S. Avidan and A. Shashua, Trajectory Triangulation: 3D Reconstruction of Moving Points from a Monocular Image Sequence IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 4, pp. 348-357, Apr. 2000.[4] P.A. Beardsley, P. Torr, and A.P. Zisserman, “3D Model Acquisition from Extended Image Sequences,” Proc. Fourth European Conf. Computer Vision, B.F. Buxton and R. Cipolla, eds., Apr. 1996.[5] S. Bougnoux, From Projective to Euclidean Space under Any Practical Situation, a Criticism of Self-Calibration Proc. Int'l Conf. Computer Vision 98, pp. 790-795, 1998.[6] C. Bregler, A. Hertzmann, and H. Biermann, Recovering Non-Rigid 3D Shape from Image Streams Proc. IEEE Conf. Computer Vision and Pattern Recognition 00, pp. 690-696, 2000.[7] S. Carlsson and D. Weinshall, Dual Computation of Projective Shape and Camera Positions from Multiple Images Int'l J. Computer Vision, vol. 27, no. 3, pp. 227-241, May 1998.[8] S. Christy and R. Horaud, Euclidean Reconstruction: From Paraperspective to Perspective Proc. European Conf. Computer Vision 96, pp. 129-140, 1996.[9] S. Christy and R. Horaud, “Euclidean Shape and Motion from Multiple Perspective Views by Affine Iteration,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 11, pp. 1098-1104, Nov. 1996.[10] J. Costeira and T. Kanade, “A Multibody Factorization Method for Independently Moving Objects,” Int'l J. Computer Vision, vol. 29, no. 31, pp. 159-179, 1998.[11] O. Faugeras, "What can be seen in three dimensions with an uncalibrated stereo rig?" Second European Conf. Computer Vision, pp. 563-578, 1992.[12] M.A. Fischler and R.C. Bolles, “Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography,” Graphics and Image Processing, vol. 24, no. 6, pp. 381–395, June 1981.[13] A.W. Fitzgibbon and A. Zisserman, Multibody Structure and Motion: 3-D Reconstruction of Independently Moving Objects Proc. European Conf. Computer Vision, 2000.[14] M. Han and T. Kanade, Creating 3D Models with Uncalibrated Cameras Proc. Workshop Applications of Computer Vision, pp. 178-185, 2000.[15] M. Han and T. Kanade, Reconstruction of a Scene with Multiple Linearly Moving Objects Proc. Conf. Computer Vision and Pattern Recognition, pp. 542-549, 2000.[16] M. Han and T. Kanade, Multiple Motion Scene Reconstruction from Uncalibrated Views Proc. Int'l Conf. Computer Vision, 2001.[17] R.I. Hartley, “An Algorithm for Self-Calibration from Several Views,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 908-912, June 1994.[18] R.I. Hartley, L. de Agapito, I.D. Reid, and E. Hayman, Camera Calibration and the Search for Infinity Proc. Int'l Conf. Computer Vision, pp. 510-515, 1999.[19] A. Heyden and K. Åström, “Euclidean Reconstruction from Image Sequences with Varying and Unknown Focal Length and Principal Point,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 438-443, 1997.[20] F. Kahl and B. Triggs, Critical Motions in Euclidean Structure from Motion Proc. Conf. Computer Vision and Pattern Recognition, pp. 366-372, 1999.[21] F. Kahl, B. Triggs, and K. Astrom, Critical Motions for Autocalibration when Some Intrinsic Parameters can Vary J. Math. Imaging and Vision, vol. 13, no. 2, pp. 131-146, Oct. 2000.[22] R. Mohr, L. Quan, and F. Veillon, Relative 3D Reconstruction Using Multiple Uncalibrated Images Int'l J. Robotics Research, vol. 14, no. 6, pp. 619-632, Dec. 1995.[23] D. Nister, Calibration with Robust Use of Cheirality by Quasi-Affine Reconstruction of the Set of Camera Projection Centres Proc. Int'l Conf. Computer Vision, pp. 116-123, 2001.[24] C. Poelman and T. Kanade, A Paraperspective Factorization Method for Shape and Motion Recovery IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 3, pp. 206-219, Mar. 1997.[25] M. Pollefeys, R. Koch, and L. VanGool, “Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters,” Int'l J. Computer Vision, vol. 32, no. 1, pp. 7-25, Aug. 1999.[26] L. Quan, Invariants of Six Points and Projective Reconstruction from Three Uncalibrated Images IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 1, pp. 34-46, Jan. 1995.[27] L. Quan, Self-Calibration of an Affine Camera from Multiple Views Int'l J. Computer Vision, vol. 19, no. 1, pp. 93-105, July 1996.[28] A. Shashua, S. Avidan, and M. Werman, Trajectory Triangulation over Conic Sections Proc. Int'l Conf. Computer Vision, pp. 330-336, 1999.[29] A. Shashua and L.B. Wolf, Homography Tensors: On Algebraic Entities that Represent Three Views of Static or Moving Planar Points Proc. European Conf. Computer Vision, 2000.[30] G. Sparr, “Simultaneous Reconstruction of Scene Structure and Camera Locations from Uncalibrated Image Sequences,” Proc. Int'l Conf. Pattern Recognition '96, pp. 328-333, 1996.[31] P. Sturm, Critical Motion Sequences and Conjugacy of Ambiguous Euclidean Reconstructions Soc. for the Certification of Information Architects, 1997.[32] P. Sturm, Critical Motion Sequences for Monocular Self-Calibration and Uncalibrated Euclidean Reconstruction Proc. Conf. Computer Vision and Pattern Recognition, pp. 1100-1105, June 1997.[33] P. Sturm, Critical Motion Sequences for the Self-Calibration of Cameras and Stereo Systems with Variable Focal Length Proc. British Machine Vision Conf., pp. 63-72, 1999.[34] P. Sturm and B. Triggs, “A Factorization Based Algorithm for Multi-Image Projective Structure and Motion,” Proc. European Conf. Computer Vision '96, vol. 2, pp. 709-720, 1996.[35] C. Tomasi and T. Kanade, "Shape and Motion From Image Streams Under Orthography: A Factorization Method," Int'l J. Computer Vision, vol. 9, no. 2, pp. 137-154, 1992.[36] P.H.S. Torr, A.W. Fitzgibbon, and A. Zisserman, Maintaining Multiple Motion Model Hypotheses over Many Views to Recover Matching and Structure Proc. Int'l Conf. Computer Vision, pp. 485-491, 1998.[37] P.H.S. Torr, A.W. Fitzgibbon, and A. Zisserman, The Problem of Degeneracy in Structure and Motion Recovery from Uncalibrated Image Sequences Int'l J. Computer Vision, vol. 32, no. 1, pp. 27-44, Aug. 1999.[38] B. Triggs, Matching Constraints and the Joint Image Proc. Int'l Conf. Computer Vision, pp. 338-343, 1995.[39] B. Triggs, “Factorisation Methods for Projective Structure and Motion,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 845-851, 1996.[40] B. Triggs, “Autocalibration and the Absolute Quadric,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 609-614, June 1997.[41] B Triggs, P.F. McLauchlan, R.I. Hartley, and A.W. Fitzgibbon, “Special Sessions—Bundle Adjustment: A Modern Synthesis,” Lecture Notes in Computer Science, vol. 1883, pp. 298-372, 2000.[42] Y. Wexler and A. Shashua, On the Synthesis of Dynamic Scenes from Reference Views Proc. Conf. Computer Vision and Pattern Recognition, pp. 576-581, 2000.[43] L. Wolf and A. Shashua, On Projection Matrices$p^k ->p^2$, k=3,$\ldots$, 6, and Their Applications in Computer Vision Proc. Int'l Conf. Computer Vision, pp. 412-419, 2001.[44] H. Yu, Q. Chen, G. Xu, and M. Yachida, 3D Shape and Motion by SVD under Higher-Order Approximation of Perspective Projection Proc. Int'l Conf. Pattern Recognition, p. A80.22, 1996.

Index Terms:
Structure from motion, motion segmentation, camera calibration, dynamic scene reconstruction, computer vision.
Citation:
Mei Han, Takeo Kanade, "Multiple Motion Scene Reconstruction with Uncalibrated Cameras," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 7, pp. 884-894, July 2003, doi:10.1109/TPAMI.2003.1206517
Usage of this product signifies your acceptance of the Terms of Use.