This Article 
 Bibliographic References 
 Add to: 
Transitory Image Sequences, Asymptotic Properties, and Estimation of Motion and Structure
May 1997 (vol. 19 no. 5)
pp. 451-464

Abstract—A transitory image sequence is one in which no scene element is visible through the entire sequence. When a camera system scans a scene which cannot be covered by a single view, the image sequence is transitory. This article deals with some major theoretical and algorithmic issues associated with the task of estimating structure and motion from transitory image sequences. It is shown that integration with a transitory sequence has properties that are very different from those with a non-transitory one. Two representations, world-centered (WC) and camera-centered (CC), behave very differently with a transitory sequence. The asymptotic error rates derived in this article indicate that one representation is significantly superior to the other, depending on whether one needs camera-centered or world-centered estimates. To establish the tightness of these error rates, it has been shown that these reachable error rates are in fact the lowest possible given by a theoretical lower error bound, the Cramér-Rao error bound. Based on these results, we introduce an efficient "cross-frame" estimation technique for the CC representation. For the WC representation, our analysis indicates that a good technique should be based on camera global pose instead of interframe motions. In addition to testing with synthetic data, rigorous experiments were conducted with real-image sequences taken by a fully calibrated camera system. The comparison of the experimental results with the ground truth has demonstrated that a good accuracy can be obtained from transitory image sequences.

[1] T.J. Broida and R. Chellappa, "Estimation of Object Motion Parameters From Noisy Images," IEEE Trans. Pattern Anal. Machine Intell., vol. 8, pp. 90-99, 1986.
[2] N. Cui, J. Weng, and P. Cohen, "Extended Structure and Motion Analysis From Monocular Image Sequences," CVGIP: Image Unserstanding, vol. 59, no. 2, pp. 154-170, Mar. 1994.
[3] T.F. Elbert, Estimation and Control of Systems.New York: Van Nostrand Reinhold, 1984.
[4] N. Ayache and O. Faugeras, "Building, Registration, and Fusing Noisy Visual Maps," Proc. First Int'l Conf. Computer Vision,England, pp. 73-82, 1987.
[5] D.G. Luenberger, Optimization by Vector Space Methods.New York: John Wiley, 1969.
[6] L. Matthies and S.A. Shafer, "Error Modeling in Stereo Navigation," IEEE J. Robotics and Automation, vol. 3, no. 3, pp. 239-248, June 1987.
[7] C.R. Rao, Linear Statistical Inference and Its Applications, 2nd ed. New York: John Wiley, 1973.
[8] H. Shariat and K.E. Price, "Motion Estimation With More Than Two Frames," IEEE Trans. Pattern Anal. Machine Intell., vol. 12, no. 5, pp. 417-434, 1990.
[9] C. Tomasi and T. Kanade, "Shape and Motion From Image Streams Under Orthography: A Factorization Method," Int'l J. Computer Vision, vol. 9, no. 2, pp. 137-154, 1992.
[10] J. Weng,N. Ahuja,, and T. S. Huang,“Matching two perspective views,” Trans. Pattern Analysis and Machine Intelligence Intell., vol. 14, no. 8, pp. 806-825, 1992.
[11] J. Weng, P. Cohen, and M. Herniou, “Camera Calibration with Distortion Models and Accuracy Evaluation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 10, pp. 965-980, Oct. 1992.
[12] J. Weng, N. Ahuja, and T. Huang, "Optimal Motion and Structure Estimation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, no. 9, pp. 864-884, 1993.

Index Terms:
Motion analysis, struction from motion, image sequences, optimal estimation, Cramér-Rao bound, optical flow.
John (Juyang) Weng, Yuntao Cui, Narendra Ahuja, "Transitory Image Sequences, Asymptotic Properties, and Estimation of Motion and Structure," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 5, pp. 451-464, May 1997, doi:10.1109/34.589205
Usage of this product signifies your acceptance of the Terms of Use.