This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Motion and Shape Recovery Based on Iterative Stabilization for Modest Deviation from Planar Motion
July 2006 (vol. 28 no. 7)
pp. 1176-1181
Isao Miyagawa, IEEE Computer Society
Kenichi Arakawa, IEEE Computer Society
We describe an iterative stabilization method that can simultaneously recover camera motion and 3D shape from an image sequence captured under modest deviation from planar motion. This technique iteratively applies a factorization method based on planar motion and can approximate the observed image points to the 2D points projected under planar motion by stabilizing the camera motion. We apply the proposed method to aerial images acquired by a helicopter-borne camera and show better reconstruction of both motion and shape than Christy-Horaud's perspective factorization. Moreover, we confirm that the reprojection errors calculated from the recovered camera motion and 3D shape are very similar to the optimum results yielded by bundle adjustment.

[1] S. Teller, “Automated Urban Model Acquisition: Project Rationale and Status,” Proc. Image Understanding Workshop, pp. 455-462, 1998.
[2] I. Stamos and P.K. Allen, “3-D Model Construction Using Range and Image Data,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 531-536, 2000.
[3] H. Zhao and R. Shibasaki, “Reconstructing Urban 3D Model Using Vehicle-Borne Laser Range Scanners,” Proc. Int'l Conf. 3D Digital Imaging and Modeling, 2001.
[4] A. Gruen and L. Zhang, “Automatic DTM Generation from Three-Line-Scanner (TLS) Images,” Int'l Archives of Photogrammetry and Remote Sensing (IAPRS), vol. 34, pp. 131-137, 2002.
[5] C. Früh and A. Zakhor, “Constructing 3D City Models by Merging Gound-Based and Airborne Views,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 562-569, 2003.
[6] F. Bignone, O. Henricsson, P. Fua, and M. Stricker, “Automatic Extraction of Generic House Roofs from High Resolution Aerial Imagery,” Proc. European Conf. Computer Vision, pp. 85-96, 1996.
[7] T. Moons, D. Frère, J. Vandekerckhove, and L.V. Gool, “Automatic Modeling and 3D Reconstruction of Urban House Roofs from High Resolution Aerial Imagery,” Proc. European Conf. Computer Vision, pp. 410-425, 1998.
[8] C. Baillard and A. Zisserman, “Automatic Reconstruction of Piecewise Planar Models from Multiple Views,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 559-565, 1999.
[9] C. Tomasi and T. Kanade, “Shape and Motion from Image Streams under Orthography: A Factorization Method,” Int'l J. Computer Vision, vol. 9, no. 2, pp. 137-154, 1992.
[10] C.J. Poelman and T. Kanade, “A Paraperspective Factorization Method for Shape and Motion Recovery,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 3, pp. 206-218, Mar. 1997.
[11] P. Sturm and B. Triggs, “A Factorization Based Algorithm for Multi-Image Projective Structure and Motion,” Proc. European Conf. Computer Vision, pp. 709-720, 1996.
[12] B. Triggs, “Factorization Methods for Projective Structure and Motion,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 845-851, 1996.
[13] T. Ueshiba and F. Tomita, “A Factorization Method for Projective and Euclidean Reconstruction from Multiple Perspective Views via Iterative Depth Estimation,” Proc. European Conf. Computer Vision, vol. 1, pp. 296-310, 1998.
[14] S. Mahamud and M. Hebert, “Iterative Projective Reconstruction from Multiple Views,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 430-437, 2000.
[15] A. Heyden, R. Berthilsson, and G. Sparr, “An Iterative Factorization Method for Projective Structure and Motion from Image Sequences,” Image and Vision Computing, vol. 17, no. 13, pp. 981-991, 1999.
[16] Q. Chen and G. Medioni, “Efficient Iterative Solution to M-View Projective Reconstruction Problem,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 55-61, 1999.
[17] S. Christy and R. Horaud, “Euclidean Shape and Motion from Multiple Perspective Views by Affine Iterations,” Technical Report 2421, INRIA, Dec. 1994.
[18] S. Christy and R. Horaud, “Euclidean Shape and Motion from Multiple Perspective Views by Affine Iterations,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 11, pp. 1098-1104, Nov. 1996.
[19] M. Han and T. Kanade, “Multiple Motion Scene Reconstruction with Uncalibrated Cameras,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 7, pp. 884-894, July 2003.
[20] B. Micusìk, D. Martinec, and T. Pajdla, “3D Metric Reconstruction from Uncalibrated Omnidirectional Images,” Proc. Asian Conf. Computer Vision, vol. 1, pp. 545-550, 2004.
[21] P. Sturm, “Critical Motion Sequences for Monocular Self-Calibration and Uncalibrated Euclidean Reconstruction,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1100-1105, 1997.
[22] J. Oliensis and Y. Genc, “Fast and Accurate Algorithms for Projective Multi-Image Structure from Motion,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 546-559, June 2001.
[23] J. Oliensis, “Structure from Linear or Planar Motions,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 335-342, 1996.
[24] J. Li and R. Chellappa, “A Factorization Method for Structure from Planar Motion,” Proc. IEEE Workshop Motion and Video Computing, vol. 2, pp. 154-159, 2005.
[25] B. Triggs, P. McLauchlan, R. Hartley, and A. Fitzgibbon, “Bundle Adjustment— A Modern Synthesis,” Vision Algorithms: Theory and Practice, pp. 298-375, 2000.
[26] M.I.A. Lourakis and A.A. Argyros, “The Design and Implementation of a Generic Sparse Bundle Adjustment Software Package Based on the Levenberg-Marquardt Algorithm,” Technical Report No. 340, Inst. of Computer Science— FORTH, 2004.
[27] G.R. Bradski and V. Pisarevsky, “Intel's Computer Vision Library: Applications in Calibration, Stereo, Segmentation, Tracking, Gesture, Face and Object Recognition,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 796-797, 2000.
[28] J. Shi and C. Tomasi, “Good Features to Track,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 593-600, 1994.

Index Terms:
Structure from motion, factorization method, planar motion, aerial image.
Citation:
Isao Miyagawa, Kenichi Arakawa, "Motion and Shape Recovery Based on Iterative Stabilization for Modest Deviation from Planar Motion," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 7, pp. 1176-1181, July 2006, doi:10.1109/TPAMI.2006.147
Usage of this product signifies your acceptance of the Terms of Use.