This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Estimating the Kinematics and Structure of a Rigid Object from a Sequence of Monocular Images
June 1991 (vol. 13 no. 6)
pp. 497-513

The problem considered involves the use of a sequence of noisy monocular images of a three-dimensional moving object to estimate both its structure and kinematics. The object is assumed to be rigid, and its motion is assumed to be smooth. A set of object match points is assumed to be available, consisting of fixed features on the object, the image plane coordinates of which have been extracted from successive images in the sequence. Structure is defined as the 3-D positions of these object feature points, relative to each other. Rotational motion occurs about the origin of an object-centered coordinate system, while translational motion is that of the origin of this coordinate system. In this work, which is a continuation of the research done by the authors and reported previously, results of an experiment with real imagery are presented, involving estimation of 28 unknown translational, rotational, and structural parameters, based on 12 images with seven feature points.

[1] G. Adiv, "Determining three-dimensional motion and structure from optical flow generated by several moving objects,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-7, pp. 384-401, July 1985.
[2] J. Aloimonos and C. M. Brown, "Perception of structure from motion: I: Optic flow vs. discrete displacements, II: Lower bound results," inProc. IEEE Conf. Computer Vision and Pattern Recognition, June 1986, pp. 510-517.
[3] D. H. Ballard and O. A. Kimball, "Rigid body motion from depth and optical flow,"Comput. vision, Graphics, Image Processing, vol. 22, pp. 95-115, Apr. 1983.
[4] S. S. Blackman,Multiple-Target Tracking with Radar Applications. Dedham, MA: Artech House, 1986.
[5] T. J. Broida, "Estimating the kinematics and structure of a moving object from a sequence of images," Ph.D. dissertation, Univ. Southern California, 1987.
[6] T. J. Broida, S. Chandrashekhar, and R. Chellappa, "Recursive estimation of 3-D kinematics and structure from noisy monocular image sequences,"IEEE Trans. Aerosp. Electron. Syst., vol. AES-26, pp. 639-656, Aug. 1990.
[7] T. Broida and R. Chellappa, "Estimation of object motion parameters from noisy images,"IEEE Trans. Pattern Anal. Machine Intell, vol. PAMI-8, no. 1, Jan. 1986.
[8] T. J. Broida and R. Chellappa, "Performance bounds for estimating three-dimensional motion parameters from a sequence of noisy images,"J. Opt. Soc. Amer. A, vol. 6, pp. 879-889, June 1989.
[9] E. D. Dickmanns, "An integrated approach to feature based dynamic vision," inProc. IEEE Conf. Computer vision and Pattern Recognition, Ann Arbor, MI, June 1988, pp. 820-825.
[10] J.-Q. Fang and T. S. Huang, "Some experiments on estimating the 3-D motion parameters of a rigid body from two consecutive image frames,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, pp. 545-554, Sept. 1984.
[11] O.D. Faugeras and M. Hebert, "A 3-D recognition and positioning algorithm using geometric matching between primitive surfaces," inProc. Int. Joint Conf. Artificial Intell., West Germany, Aug. 1983, pp. 996-1002.
[12] B. Friedland, "Analysis of strapdown navigation using quaternions,"IEEE Trans. Aerosp. Electron. Syst., vol. AES-14, pp. 764-768, Sept. 1978.
[13] D.B. Gennery, "Tracking known 3-D objects," inProc. Nat. Conf. Artificial Intell., Aug. 1982, pp. 13-17.
[14] E. Hildreth, "Computation underlying the measurement of visual motion,"Artificial Intell., vol. 23, pp. 309-354, 1984.
[15] R. C. Jain, "Segmentation of frame sequences obtained by a moving observer,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, pp. 624-629, Sept. 1984.
[16] J.K. Kearny, W.B. Thompson, and D.L. Boley, "Optical flow estimation: An error analysis of gradient-based methods with local optimization,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-9, pp. 229-244, Mar. 1987.
[17] Y.C. Kim and J.K. Aggarwal, "Determining object motion in a sequence of stereo images,"IEEE J. Robotics and Automat., vol. RA-3, pp. 599-614, Dec. 1987.
[18] K. Konstantinides and K. Yao, "Statistical analysis of effective singular values in matrix rank determination,"IEEE Trans. Acoust., Speech, Signal Processing, vol. 36, pp. 757-763, May 1988.
[19] K. M. Mutch and W. B. Thompson, "Analysis of accretion and deletion at boundaries in dynamic scenes,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-7, pp. 133-138, Mar. 1985.
[20] G.D. Niva, "The use of quaternions with an all-attitude IMU," inProc. Annu. Rocky Mountain Guidance and Control Conf., Jan. 1982, pp. 269-283.
[21] M. J. D. Powell, "Restart procedures for the conjugate gradient method,"Math. Program., vol. 12, pp. 241-254, Apr. 1977.
[22] J. Roach and J. Aggarwal, "Determining the movement of objects from a sequence of images,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-2, pp. 554-562, Nov. 1980.
[23] W. Rudin,Principles of Mathematical Analysis. New York: McGraw-Hill, 1976.
[24] L. E. Scales,Introduction to Non-linear Optimization. New York: Springer-Verlag, 1985.
[25] I.K. Sethi and R. Jain, "Finding trajectories of feature points in a monocular image sequence,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-9, pp. 56-73, Jan. 1987.
[26] H. Shariat and K. Price, "Motion estimation with more than two frames,"IEEE Trans. Pattern Anal. Machine Intell., vol. 12, pp. 417-434, May 1990.
[27] B. Sridhar and A. V. Phatak, "Simulation and analysis of image-based navigation system of rotorcraft low altitude flight," inProc. Amer. Helicopter Soc. Meeting, Atlanta, GA, Apr. 1988.
[28] D.V. Stallard, "An angle-only tracking filter in modified spherical coordinates," inProc. AIAA Guidance, Navigation, and Control Conf., 1986.
[29] N. Sugie and H. Inagaki, "Recovery of the 3-D structure of a moving object from orthographically projected optical flow,"Trans. Soc. Instrum. Contr. Eng., vol. 20, pp. 837-843, Sept. 1984.
[30] W. B. Thompson, K. M. Mutch, and V. A. Bersins, "Dynamic occlusion analysis in optical flow fields,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-7, pp. 374-383, July 1985.
[31] A. Tirumalaiet al., "A non-linear optimization algorithm for the estimation of structure and motion parameters," inProc. IEEE Comput. Soc. Conf. Computer Vision and Pattern Recognition, San Diego, CA, June 1989, pp. 136-143.
[32] R.Y. Tsai and T.S. Huang, "Uniqueness and estimation of three-dimensional motion parameters of rigid objects with curved surfaces,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, pp. 13-27, Jan. 1984.
[33] J.A. Webb and J.K. Aggarwal, "Visually interpreting the motion of objects in space,"Computer, vol. 14, pp. 40-46, Aug. 1981.
[34] J. Weng, N. Ahuja, and T. S. Huang, "Closed form solution + maximum likelihood: A robust approach to motion and structure estimation," inProc. IEEE Conf. Computer vision and Pattern Recognition, June 1988.
[35] J. Weng, T.S. Huang, and N. Ahuja, "3-D motion estimation, understanding, and prediction from noisy image sequences,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-9, no. 3, 1987.
[36] J. R. Wertz, Ed.,Spacecraft Attitude Determination and Control. Dordrect, The Netherlands: D. Reidel, 1978.
[37] Y. Yasumoto and G. Medioni, "Robust estimation of three-dimensional motion parameters from a sequence of image frames using regularization,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-8, pp. 464-471, 1986.
[38] G. S. Young and R. Chellappa, "3-D motion estimation using a sequence of noisy stereo images: Models, estimation and uniqueness results,"IEEE Trans. Pattern Anal. Machine Intell., vol. 12, pp. 735-759, Aug. 1990.
[39] X. Zhuang, T. S. Huang, and R. H. Haralick, "A simple procedure to solve motion and structure from three orthographic views,"IEEE J. Robotics Automat., vol. 4, pp. 236-239, Apr. 1988.

Index Terms:
structure estimation; parameter estimation; pattern recognition; kinematics; rigid object; monocular images; object match points; kinematics; parameter estimation; pattern recognition
Citation:
T. Broida, R. Chellappa, "Estimating the Kinematics and Structure of a Rigid Object from a Sequence of Monocular Images," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 13, no. 6, pp. 497-513, June 1991, doi:10.1109/34.87338
Usage of this product signifies your acceptance of the Terms of Use.