This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Motion Estimation with More than Two Frames
May 1990 (vol. 12 no. 5)
pp. 417-434

The development of a general motion estimation system based on using three or more frames is reported. The relevant portion of the sequence is treated as a whole, thus simplifying the process of estimating the motion parameters, and making possible the computation of the motion parameters in terms of the natural center of motion. A general description of this motion estimation method is presented, with the derivation of motion equations for three cases (three points in three frames, two points in four frames, and one point in five frames). Results are given for real and synthetic images for the case of one point in five (and six) frames. On the average, the program converged quickly to the right answer for noiseless data. For noisy data, the answers were reasonable and their accuracy was directly a function of the amount of noise in the disparity vector.

[1] J. A. Webb and J. K. Aggarwal, "Structure from motion of rigid and jointed objects,"Artificial Intell., vol. 19, no. 1, pp. 107-130, Sept. 1982.
[2] D. D. Hoffman and B. E. Flinchbaugh, "The interpretation of biological motion,"Biol. Cybern., vol. 42, no. 3, pp. 195-204, 1982.
[3] L. Dreschler and H.-H. Nagel, "Volumetric model and 3-D trajectory of a moving car derived from monocular TV-frame sequence of a street scene,"Comput. Graphics Image Processing, vol. 20, no. 3, pp. 199-228, Nov. 1982.
[4] J. W. Roach and J. K. Aggarwal, "Determining the movement of objects from a sequence,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-2, no. 6, pp. 554-562, Nov. 1980.
[5] D. H. Ballard and O. A. Kimball, "Rigid body motion from depth and optical flow,"Comput. Vision, Graphics, Image Processing, vol. 22, no. 1, pp. 95-115, Apr. 1983.
[6] T. J. Broida and R. Chellappa, "Kinematics of a rigid object from a sequence of noisy images: A batch approach," inProc. IEEE Conf. Computer Vision and Pattern Recognition, Miami Beach, FL, June 1986, pp. 176-182.
[7] T. J. Broida and R. Chellappa, "Estimation of object motion parameters from noisy images," inProc. IEEE Conf. Computer Vision and Pattern Recognition, San Francisco, CA, June 1985, pp. 82-88.
[8] T. Broida and R. Chellappa, "Estimation of object motion parameters from noisy images,"IEEE Trans. Pattern Anal. Machine Intell, vol. PAMI-8, no. 1, Jan. 1986.
[9] T. J. Broida and R. Chellappa, "Kinematics and structure of a rigid object from a sequence of noisy images," inProc. Workshop Motion: Representation and Analysis, IEEE, Kiawah Island, SC, May 1986, pp. 95-100.
[10] R. C. Bolles and H. H. Baker, "Epipolar-plane image analysis: A technique for analyzing motion sequences," inProc. IEEE 3rd Workshop Computer Vision: Representation and Control, Bellaire, MI, Oct. 1985, pp. 168-178.
[11] D. T. Lawton, "Constraint-based inference from image motion," inProc. 1st Annu. Nat. Conf. Artificial Intelligence, Stanford Univ., Aug. 1980.
[12] A. Mitiche, S. Seida, and J. K. Aggarwal, "Determining position and displacement in space from images," inProc. IEEE Conf. Computer Vision and Pattern Recognition, San Francisco, CA, June 1985, pp. 504-509.
[13] J. K. Aggarwal and A. Mitiche, "Structure and motion from images," inProc. Image Understanding Workshop, DARPA, Miami Beach, FL, Dec. 1985, pp. 89-97.
[14] S. Ullman,The Interpretation of Visual Motion. Cambridge, MA: MIT Press, 1979.
[15] A. Z. Meiri, "On monocular perception of 3-D moving objects,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-2, pp. 582- 583, 1980.
[16] B. L. Yen and T. S. Huang, "Determining 3-D motion and structure of a rigid body using the spherical projection,"Comput. Vision, Graphics, Image Processing, vol. 21, pp. 21-32, 1983.
[17] M. Asada and S, Tsuji, "Representation of three-dimensional motion in dynamic scenes,"Comput. Vision, Graphics, Image Processing, vol. 21, no. 1, pp. 118-144, Jan. 1983.
[18] R. Y. Tsai and T. S. Huang, "Uniqueness and estimation of three-dimensional motion parameters of rigid objects with curved surfaces,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, pp. 13-27, Jan. 1984.
[19] R. Tsai and T. Huang, "Estimating 3-D motion parameters of a rigid planar patch, i,"IEEE Trans. Acous. Speech Signal Processing, vol. ASSP-29, pp. 1147-1152, Dec. 1981.
[20] R. Y. Tsai and T. S. Huang, "Estimating 3-D motion parameters of a rigid planar patch," inProc. IEEE Conf. Pattern Recognition and Image Processing, Dallas, TX, Aug. 1981.
[21] G. Adiv, "Determining 3-D motion and structure from optical flow generated by several moving objects,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-7, no. 4, pp. 384-401, July 1985.
[22] K. Prazdny, "Egomotion and relative depth map from optical flow,"Biol. Cybern., vol. 36, pp. 87-102, 1980.
[23] H.-H. Nagel and B, Neumann, "On 3-D reconstruction from two perspective views," inProc. Int. Joint Conf. Artificial Intelligence, Vancouver, B.C., Canada, Aug. 1981.
[24] H.-H. Nagel, "On the derivation of 3-D rigid point configurations from image sequences," inProc. IEEE Conf. Pattern Recognition and Image Processing, Dallas, TX, Aug. 1981.
[25] H.-H. Nagel, "Representation of moving rigid objects based on visual observation,"Computer, vol. 14, no. 8, pp. 29-39, Aug. 1981.
[26] J. Q. Fang and T. S. Huang, "Solving 3-D small-rotation, motion equations: Uniqueness, algorithms, and numerical results,"Comput. Vision, Graphics, Image Processing, vol. 26, pp. 183-206, 1984.
[27] H. Shariat, "The motion problem: How to use more than two frames, Ph.D. dissertation, Dep. Elec. Eng., Univ. Southern California, Los Angeles, IRIS Rep. 202, 1986.
[28] J. K. Aggarwal and A. Mitiche, "Structure and motion from images: Fact and fiction," inProc. IEEE 3rd Workshop Computer Vision: Representation and Control, Bellaire, MI, Oct. 1985, pp. 127-128.
[29] R. Ohlander, K. Price, and D. R. Reddy, "Picture segmentation using a recursive region splitting method,"Comput. Graphics Image Processing, vol. 8, pp. 313-333, 1978.
[30] O. D. Faugeras and K. E. Price, "Semantic description of aerial images using stochastic labeling,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-3, no. 6, pp. 633-642, Nov. 1981.
[31] Y. Yasumoto and G. Medioni, "Experiments in estimation of 3-D motion parameters from a sequence of image frames," inProc. IEEE Conf. Computer Vision and Pattern Recognition, San Francisco, CA, June 1985, pp. 89-94.
[32] G. Medioni and Y. Yasumoto, "Robust estimation of 3-D motion parameters from a sequence of image frames using regularization," inProc. Image Understanding Workshop, DARPA, Miami Beach, FL, Dec. 1985, pp. 117-128.
[33] H. Shariat and K. E. Price, "How to use more than two frames to estimate motion," inProc. IEEE Workshop Motion: Representation and Analysis, Kiawah Island, SC, May 1986, pp. 119-124.
[34] A. Mitiche, S. Seida, and J. Aggarwal, "Line-based computation of structure and motion using angular invariance," inProc. IEEE Workshop Motion: Representation and Analysis, Kiawah Island, SC, May 1986, pp. 175-180.
[35] Y. Liu and T. S. Huang, "Estimation of rigid body motion using straight line correspondences," inProc. IEEE Workshop Motion: Representation and Analysis, Kiawah Island, SC, May 1986, pp. 47- 52.
[36] C.-H. Lee and A. Rosenfeld, "Structure and motion of a rigid object having unknown constant motion," inProc. IEEE Workshop Motion: Representation and Analysis, Kiawah Island, SC, May 1986, pp. 145- 150.
[37] X. Zhuang and R. Haralick, "Two view motion analysis," inProc. IEEE Conf. Computer Vision and Pattern Recognition, San Francisco, CA, June 1985, pp. 686-690.

Index Terms:
computer vision; motion estimation; noise; disparity vector; computer vision; computerised picture processing
Citation:
H. Shariat, K.E. Price, "Motion Estimation with More than Two Frames," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 12, no. 5, pp. 417-434, May 1990, doi:10.1109/34.55102
Usage of this product signifies your acceptance of the Terms of Use.