This Article 
 Bibliographic References 
 Add to: 
Image Description and 3-D Reconstruction From Image Trajectories of Rotational Motion
September 1993 (vol. 15 no. 9)
pp. 885-898

A new technique for reconstructing the 3-D structure and motion of a scene undergoing relative rotational motion with respect to the camera is discussed. Given image correspondences of point features tracked over many frames, a two-stage technique for reconstruction is presented. A grouping algorithm that exploits spatio-temporal constraints of the common motion to achieve a reliable description of discrete point correspondences as curved trajectories in the image plane is developed. In contrast, trajectories fitted to points independent of each other lead to arbitrary image descriptions and very inaccurate 3-D parameters. A new closed-form solution, under perspective projection, for the 3-D motion and location of points from the computed image trajectories is also presented. Both stages are applied to real image sequences with good results. This approach represents a first step in a longer-term research effort examining the role of explicit spatio-temporal organization in the interpretation of scenes from dynamic images.

[1] G. Adiv, "Determining 3-D motion and structure from optical flows generated by several moving objects,"IEEE Trans. Pattern Anal. Machine Intell., vol. 7, no. 4, pp. 384-401, 1985.
[2] G. Adiv, "Interpreting optical flow," Ph.D. thesis, Univ. Massachusetts, Amherst, MA, 1985.
[3] G. Adiv, "Inherent ambiguities in recovering 3-D information from a noisy flow field,"IEEE Trans. Patt. Anal. Machine Intell., vol. 11, no. 5, pp. 477-489, 1989.
[4] J. K. Aggarwal and N. Nandhakumar, "On the computation of motion from sequence of images--Review," Tech. Rep. TR-88-2-47, Univ. Texas, Austin, 1988.
[5] P. Anandan, "A computational framework and an algorithm for the measurement of visual motion,"Int. J. Comput. Vision, vol. 2, no. 3, pp. 283-310, 1989.
[6] M. Boldt, R. Weiss, and E. Riseman, "Token based extraction of straight lines,"IEEE Syst. Man Cybern, vol. 19, no. 6, pp. 1581-1594, Dec. 1989.
[7] F. L. Bookstein, "Fitting conic sections to scattered data,"Comput. Graphics Image Processing, vol. 9, pp. 56-71, 1979.
[8] T. Broida and R. Chellappa, "Experiments and uniqueness results on object structure and kinematics from a sequences of monocular images," inProc. IEEE Workshop Visual Motion(Irvine, CA), Mar. 1989, pp. 21-30.
[9] D. S. Chen, "A data-driven intermediate level feature extraction algorithm,"IEEE Trans. Patt. Anal. Machine Intell., vol. 11, no. 7, pp. 749-758, 1989.
[10] R. T. Collins and R. Weiss, "An efficient and accurate method for computing vanishing points," inProc. Topical Mtg. Opt. Soc. Amer. Image Understanding, 1989, pp. 92-94.
[11] K. Daniilidis and H. H. Nagel, "Analytical results on error sensitivity of motion estimation from two views," inProc. 1st Euro. Conf. Comput. Vision, 1990, pp. 199-208.
[12] O. D. Faugeras, F. Lustman, and G. Toscani, "Motion and structure from motion from point and line matches," inIEEE First Int. Conf. Comput. Vision, 1987, pp. 25-34.
[13] D. A. Forsyth, J. L. Mundy, A. Zisserman, and C. M. Brown, "Projectively invariant representations using implicit algebraic curves," inProc. European Conf. Computer Vision, June 1990.
[14] B. K. P. Horn, "Relative orientation,"Int. J. Computer Vision, vol. 4, no. 1, pp. 59-78, 1990.
[15] R. A. Jaenicke, "Structure from limited motion of complex objects," inProc. IEEE Workshop Visual Motion, 1989, pp. 256-263.
[16] R. Kumar and A. R. Hanson, "Robust estimation of camera location and orientation from noisy data having outliers," inProc. Workshop Interpretation of 3D Scene, Austin, TX, 1989, pp. 52-60.
[17] R. Kumar and A. Hanson, "Sensitivity of the pose refinement problem to accurate estimation of camera parameters," inProc. 3nd Int. Conf. Comput. Vision, 1990, pp. 365-369.
[18] Y. G. Leclerc, "Constructing simple stable descriptions for image partitioning,"Int. J. Comput. Vision, vol. 3, no. 1, pp. 73-102, 1989.
[19] R. K. Lenz and R. Y. Tsai, "Tecniques for calibration of the scale factor and image center for high accuracy 3D machine vision metrology,"IEEE Trans. Patt. Anal. Machine Intell., vol. 10, no. 5, pp. 713-719, 1988.
[20] D. H. Marimont, "Inferring spatial structure from feature correspondence," Ph.D. thesis, Stanford Univ., Stanford, CA, 1986.
[21] J. Porrill, "Fitting ellipses and predicting confidence envelopes using a bias corrected Kalman filter,"Image Vision Comput., vol. 8, pp. 37-41, 1990.
[22] K. S. Roberts, "A new representation for a line," inProc. Comput. Vision," Patt. Recogn., Ann Arbor, MI, 1988.
[23] P. D. Sampson, "Fitting conic sections to very scattered date,"Comput. Graphics Image Processing, 1982, pp. 97-108.
[24] H. S. Sawhney and J. Oliensis, "Description and interpretation of rotational motion from images trajectories," Tech. Rep. COINS TR 89-90, Univ. Mass., Amherst, MA, 1989.
[25] H. Shariat, "The motion problem: How to use more than two frames," Ph.D. thesis, Univ. of Southern California, Los Angeles, 1986.
[26] M. E. Spetsakis and J. Aloimonos, "Optimal computing of structure from motion using point correspondences in two frames," Tech. Rep. CARTR-389, Comput. Vision Lab., Cent. Automat. Res., Univ. Maryland, College Park, 1988.
[27] K. A. Stevens, "Computation of locally parallel structure,"Biolog. Cybern., vol. 29, pp. 19-28, 1978.
[28] J. Todd, "Visual information about rigid and non-rigid motion: A geometric analysis,"J. Experimental Psychol.: Human Perception Performance, vol. 8, no. 2, pp. 238-252, 1982.
[29] R. Y. Tsai and T. S. Huang, "Uniqueness and estimation of 3D motion parameters and surface structures of rigid objects," inImage Understanding 1984(W. Richards and S. Ullman, Eds.). New Jersey: Ablex, 1984, pp. 135-171.
[30] J. A. Webb and J. K. Aggarwal, "Structure from motion of rigid and jointed objects,"Artificial Intell., vol. 19, pp. 107-130, 1982.
[31] J. Weng, N. Ahuja, and T. S. Huang, "Optimal motion and structure estimation," inProc. IEEE Conf. Comput. Vision Patt. Recogn.(San Diego, CA), 1989, pp. 144-152.
[32] J. Weng, T.S. Huang, and N. Ahuja, "3-D motion estimation, understanding, and prediction from noisy image sequences,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-9, no. 3, 1987.
[33] J. Weng, T. S. Huang, and N. Ahuja, "Motion and structure from two perspective views: Algorithms, error analysis, and error estimation,"IEEE Trans. Patt. Anal. Machine Intell., vol. 11, no. 5, pp. 451-476, 1989.
[34] W. H. Press, B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling,Numerical Recipes in C. Cambridge, UK: Cambridge University Press, 1986.
[35] L. R. Williams and A. R. Hanson, "Translating optical flow into token matches and depth from looming, inProc. 2nd Int. Conf. Comput. Vision, 1988, pp. 441-448.

Index Terms:
image description; 3-D reconstruction; image trajectories; rotational motion; two-stage technique; grouping algorithm; spatio-temporal constraints; discrete point correspondences; curved trajectories; closed-form solution; perspective projection; image reconstruction
H.S. Sawnhey, J. Oleinsis, A.R. Hanson, "Image Description and 3-D Reconstruction From Image Trajectories of Rotational Motion," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, no. 9, pp. 885-898, Sept. 1993, doi:10.1109/34.232075
Usage of this product signifies your acceptance of the Terms of Use.