This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Motion Estimation in Image Sequences Using the Deformation of Apparent Contours
February 1999 (vol. 21 no. 2)
pp. 114-127

Abstract—The problem of determining the camera motion from apparent contours or silhouettes of a priori unknown curved three-dimensional surfaces is considered. In a sequence of images, it is shown how to use the generalized epipolar constraint on apparent contours. One such constraint is obtained for each epipolar tangency point in each image pair. An accurate algorithm for computing the motion is presented based on a maximum likelihood estimate. It is shown how to generate initial estimates on the camera motion using only the tracked contours. It is also shown that in theory the motion can be calculated from the deformation of a single contour. The algorithm has been tested on several real image sequences, for both Euclidean and projective reconstruction. The resulting motion estimate is compared to motion estimates calculated independently using standard feature-based methods. The motion estimate is also used to classify the silhouettes as curves or apparent contours. This is a strong indication that the motion estimate is of good quality. The statistical evaluation shows that the technique gives accurate and stable results.

[1] K. Åström, R. Cipolla, and P.J. Giblin, “Generalised Epipolar Constraints,” Proc. Fouth European Conf. Computer Vision, B.F. Buxton and R. Cipolla, eds., vol. II, pp. 97-108, Apr. 1996.
[2] A. Heyden and K. Åström, “Euclidean Reconstruction from Constant Intrinsic Parameters,” Proc. Int'l Conf. Pattern Recognition, vol. 1, pp. 339-343, Aug. 1996.
[3] K. Åström and A. Heyden, "Stochastic Analysis of Image Acquisition and Scale-Space Smoothing," J. Sporring, M. Nielsen, L. Florack, and P. Johansen, eds., Gaussian Scale-Space Theory. Kluwer Academic Publishers, 1997.
[4] K.B. Atkinson, Close Range Photogrammetry and Machine Vision. Whittles Publishing, 1996.
[5] R. Berthilsson and K. Åström, "Reconstruction of 3D-Curves From 2D-Images Using Affine Shape Methods for Curves," Proc. Conf. Computer Vision and Pattern Recognition, 1997.
[6] R. Berthilsson, K. Åström, and A. Heyden, "Projective Reconstruction of 3D-Curves From Its 2D-Images Using Error Models and Bundle Adjustments," Proc. 10th Scandinavian Conf. Image Analysis, pp. 581-588,Lappeenranta, Finland, 1997.
[7] A. Blake and A.L. Yuille, eds., Active Vision.Cambridge, Mass.: MIT Press, 1992.
[8] E. Boyer and M.O. Berger, “3D Surface Reconstruction Using Occluding Contours,” Int'l J. Computer Vision, vol. 22, no. 3, pp. 219-233, Mar./Apr. 1997.
[9] S. Carlsson, "Sufficient Image Structure for 3D Motion and Shape Estimation," J.-O. Eklundh, ed., Proc. Third European Conf. Computer Vision, vol. 1, pp. 83-91,Stockholm, 1994.
[10] R. Cipolla, Active Visual Inference of Surface Shape, PhD thesis, Univ. of Oxford, 1991. Also published by Springer-Verlag as LNCS 1016 (1995).
[11] R. Cipolla, K. Åström, and P.J. Giblin, “Motion from the Frontier of Curved Surfaces,” Proc. Fifth Int'l Conf. Computer Vision, pp. 269-275, June 1995.
[12] R. Cipolla and A. Blake, “Surface Shape from the Deformation of Apparent Contours,” Int'l J. Computer Vision, vol. 9, no. 2, pp. 83-112, Nov. 1992.
[13] H. Cramér, Mathematical Methods of Statistics.Princeton, N.J.: Princeton Univ. Press, 1946.
[14] R. Curwen and A. Blake, "Dynamic Contours: Real-Time Active Splines," A. Blake and A. Yuille, eds., Active Vision.Cambridge, Mass.: MIT Press, 1992, pp. 39-58.
[15] O. Faugeras, "What can be seen in three dimensions with an uncalibrated stereo rig?" Second European Conf. Computer Vision, pp. 563-578, 1992.
[16] O. Faugeras, T. Luong, and S. Maybank, “Camera Self-Calibration: Theory and Experiments,” Proc Second European Conf. Computer Vision, pp. 321-334, May 1992.
[17] J.D. Foley,A. van Dam,S.K. Feiner,, and J.F. Hughes,Computer Graphics: Principles and Practice,Menlo Park, Calif.: Addison-Wesley, 1990.
[18] P.J. Giblin, F.E. Pollick, and J.E. Rycroft, "Recovery of an Unknown Axis or Rotation From the Profiles of a Rotating Surface," J. Optical Soc. Amer., vol. 11A, pp. 1,976-1,984, 1994.
[19] P.J. Giblin and R. Weiss, "Reconstruction of Surfaces From Profiles," Proc. First Int'l Conf. Computer Vision, pp. 136-144,London, 1987.
[20] T. Joshi, N. Ahuja, J. Ponce, "Structure and Motion Estimation From Dynamic Silhouettes Under Perspective Projection," Int'l Conf. Computer Vision, pp. 290-295,Boston, June 1995.
[21] F. Kahl and K. Åström, "Motion Estimation in Image Sequences Using the Deformation of Apparent Contours," Proc. Sixth Int'l Conf. Computer Vision, pp. 934-944,Mumbai, India, 1998.
[22] M. Kass, A. Witkin, and D. Terzopoulos, "Snakes: Active Contour Models," Int'l J. Computer Vision, vol. 1, no. 4, pp. 321-331, 1987.
[23] J. Porrill and S.B. Pollard, “Curve Matching and Stereo Calibration,” Image and Vision Computing, vol. 9, no. 1, pp. 45-50, Feb. 1991.
[24] J.H. Rieger, "Three Dimensional Motion From Fixed Points of a Deforming Profile Curve," Optics Letters, vol. 11,k pp. 123-125, 1986.
[25] J.G. Semple and G.T. Kneebone, Algebraic Projective Geometry.Oxford, England: Clarendon Press, 1952.
[26] G. Sparr, "An Algebraic-Analytic Method for Affine Shapes of Point Configurations," Proc. Seventh Scandinavian Conf. Image Analysis, pp. 274-281, 1991.
[27] G. Sparr, “Simultaneous Reconstruction of Scene Structure and Camera Locations from Uncalibrated Image Sequences,” Proc. Int'l Conf. Pattern Recognition '96, pp. 328-333, 1996.
[28] R. Szeliski and R. Weiss, "Robust Shape Recovery From Occluding Contours Using a Linear Smoother," T. Terzopoulis and C.M. Brown, eds., Real-Time Vision.Cambridge, England: Cambridge Univ. Press, 1994.
[29] F. Ulupinar and R. Nevatia, "Perception of 3-D surfaces From 2-D Contours," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 1, pp. 3-18, Jan. 1993.
[30] R. Vaillant and O.D. Faugeras, "Using Extremal Boundaries for 3-D Object Modelling," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 157-173, Feb. 1992.
[31] B. Vijayakumar, D. Kriegman, and J. Ponce, "Invariant-Based Recognition of Complex 3D Curved Objects From Image Contours," Proc. Fifth Int'l Conf. Computer Vision, pp. 508-514,Boston, 1995.
[32] B. Vijayakumar, D. Kriegman, and J. Ponce, "Structure and Motion of Curved 3D Objects From Monocular Silhouettes," Proc. Conf. Computer Vision and Pattern Recognition, pp. 327-334, 1996.
[33] Z. Zhang, “Determining the Epipolar Geometry and Its Uncertainty—A Review,” Int'l J. Computer Vision, vol. 27, no. 2, pp. 161-195, 1998.

Index Terms:
Motion, surface geometry, silhouette, epipolar constraint.
Citation:
Kalle Åström, Fredrik Kahl, "Motion Estimation in Image Sequences Using the Deformation of Apparent Contours," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21, no. 2, pp. 114-127, Feb. 1999, doi:10.1109/34.748821
Usage of this product signifies your acceptance of the Terms of Use.