This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Multiview Constraints on Homographies
February 2002 (vol. 24 no. 2)
pp. 214-223
ASCII Text
x 
 
Lihi Zelnik-Manor, Michal Irani, "Multiview Constraints on Homographies," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 2, pp. 214-223, February, 2002.
 
 
BibTex
x
 
@article{ 10.1109/34.982901,
author = {Lihi Zelnik-Manor and Michal Irani},
title = {Multiview Constraints on Homographies},
journal ={IEEE Transactions on Pattern Analysis and Machine Intelligence},
volume = {24},
number = {2},
issn = {0162-8828},
year = {2002},
pages = {214-223},
doi = {http://doi.ieeecomputersociety.org/10.1109/34.982901},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - JOUR
JO - IEEE Transactions on Pattern Analysis and Machine Intelligence
TI - Multiview Constraints on Homographies
IS - 2
SN - 0162-8828
SP214
EP223
EPD - 214-223
A1 - Lihi Zelnik-Manor,
A1 - Michal Irani,
PY - 2002
KW - Homographies
KW - homologies
KW - motion estimation
KW - multiview analysis.
VL - 24
JA - IEEE Transactions on Pattern Analysis and Machine Intelligence
ER -
 

Abstract—The image motion of a planar surface between two camera views is captured by a homography (a 2D projective transformation). The homography depends on the intrinsic and extrinsic camera parameters, as well as on the 3D plane parameters. While camera parameters vary across different views, the plane geometry remains the same. Based on this fact, we derive linear subspace constraints on the relative homographies of multiple (\geq 2) planes across multiple views. The paper has three main contributions: 1) We show that the collection of all relative homographies (homologies) of a pair of planes across multiple views, spans a 4-dimensional linear subspace. 2) We show how this constraint can be extended to the case of multiple planes across multiple views. 3) We show that, for some restricted cases of camera motion, linear subspace constraints apply also to the set of homographies of a single plane across multiple views. All the results derived in this paper are true for uncalibrated cameras. The possible utility of these multiview constraints for improving homography estimation and for detecting nonrigid motions are also discussed.

[1] J.R. Bergen, P. Anandan, K.J. Hanna, and R. Hingorani, “Hiercharchical Model-Based Motion Estimation,” Proc. European Conf. Computer Vision, pp. 237-252, 1992.
[2] S. Birchfield, “KLT: An Implementation of the Kanade-Lucas-Tomasi Feature Tracker,” http://robotics.stanford.edu/~birchklt.
[3] S. Carlsson and D. Weinshall, Dual Computation of Projective Shape and Camera Positions from Multiple Images Int'l J. Computer Vision, vol. 27, no. 3, pp. 227-241, May 1998.
[4] C. Criminisi, I. Reid, and Z. Zisserman, “Duality, Rigidity, and Planar Parallax,” Proc. European Conf. Computer Vision, vol. II, 1998.
[5] J.Q. Fang and T.S. Huang, “Solving Three-Dimensional Small-Rotation Motion Equations,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 253-258, 1983.
[6] O.D. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint.Cambridge, Mass.: MIT Press, 1993.
[7] A.W. Fitzgibbon and A. Zisserman, “Automatic Camera Recovery for Closed or Open Image Sequences,” Proc. European Conf. Computer Vision, pp. 310–326, 1998.
[8] L. Van Gool, L. Proesmans, and A. Zisserman, “Grouping and Invariants Using Planar Homologies,” Proc. Workshop Geometrical Modeling and Invariants for Computer Vision, 1995.
[9] R.I. Hartley, In Defense of the 8-Point Algorithm IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 6, pp. 580-593, June 1997.
[10] R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge Univ. Press, 2000.
[11] M. Irani, P. Anandan, and D. Weinshall, “From Reference Frames to Reference Planes: Multi-View Parallax Geometry and Applications,” Proc. European Conf. Computer Vision, vol. II, pp. 829-845, 1998.
[12] M. Irani, B. Rousso, and S. Peleg, “Computing Occluding and Transparent Motions,” Int'l J. Computer Vision, vol. 12, no. 1, pp. 5-16, Jan. 1994.
[13] M. Irani, P. Anandan, and S. Hsu, “Mosaic Based Representations of Video Sequences and Their Applications,” Proc. Fifth Int'l Conf. Computer Vision, pp. 605-611, June 1995.
[14] K. Kanatani, “Optimal Homograhpy Computation with a Reliability Measure,” Proc. IAPR Workshop Machine Vision, pp. 17–19, Nov. 1998.
[15] B.D. Lucas and T. Kanade, “An Iterative Image Registration Technique With an Application to Stereo Vision,” Proc. Image Understanding Workshop, pp. 121–130, 1981.
[16] J. Ma and N. Ahuja, “Dense Shape and Motion from Region Correspondences by Factorization,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 219–224, 1998.
[17] P. Pritchett and A. Zisserman, “Matching and Reconstruction from Widely Separated Views In 3D Structure from Multiple Images of Large-Scale Environments,” Lecture Notes in Computer Science 1506, Springer-Verlag, pp. 219–224, 1998.
[18] Q.T. Luong and O. Faugeras, “Determining the Fundamental Matrix with Planes,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 489–494, June 1998.
[19] W.H. Press, S.A. Teukolsky, W.T. Vetterling, and B.P. Flannery, Numerical Recipes in C, second ed. Cambridge Univ. Press, 1992.
[20] J.G. Semple and G.T. Kneebone, Algebraic Projective Geometry. New York: Oxford Univ. Press, 1952.
[21] A. Shashua, "Projective Structure From Uncalibrated Images: Structure-From-Motion and Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 8, pp. 778-790, Aug. 1994.
[22] A. Shashua and S. Avidan, "The Rank4 Constraint in Multiple View Geometry," Proc. European Conf. Computer Vision,Cambridge, UK, Apr. 1996.
[23] D. Sinclair, H. Christensen, and C. Rothwell, “Using the Relation Between a Plane Projectivity and the Fundamental Matrix,” SCIA, pp. 181–188, 1996.
[24] C.E. Springer, Geometry and Analysis of Projective Spaces. 1964.
[25] R. Szeliski and P. Torr, “Geometrically Constrained Structure from Motion: Points on Planes,” Proc. European Workshop 3D Structure from Multiple Images of Large-Scale Environments (SMILE), pp. 171-186, June 1998.
[26] B. Triggs, “Autocalibration from Planar Scenes,” Proc. Fifth European Conf. Computer Vision, pp. 89-105, June 1998.
[27] B. Triggs, “Plane + Parallax, Tensors and Factorization,” Proc. Sixth European Conf. Computer Vision, D. Vernon, ed., pp. 522-538, June/July 2000.
[28] T. Vieville, C. Zeller, and L. Robert, “Using Collineations to Compute Motion and Structure in an Uncalibrated Image Sequence,” Int'l J. Computer Vision, vol. 20, pp. 213–242, 1996.
[29] L. Zelnik-Manor and M. Irani, “Multi-Frame Estimation of Planar Motion,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 10, pp. 1105–1116, Oct. 2000.
[30] L. Zelnik-Manor and M. Irani, “Multiview Subspace Constraints on Homographies,” Proc. IEEE Int'l Conf. Computer Vision, vol. 1, pp. 710-715, Sept. 1999.
[31] Z.Y. Zhang, A Flexible New Technique for Camera Calibration Proc. Int'l Conf. Computer Vision, vol. 1, pp. 666-673, Sept. 1999.

Index Terms:
Homographies, homologies, motion estimation, multiview analysis.
Citation:
Lihi Zelnik-Manor, Michal Irani, "Multiview Constraints on Homographies," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 2, pp. 214-223, Feb. 2002, doi:10.1109/34.982901
Usage of this product signifies your acceptance of the Terms of Use.