The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.04 - April (2008 vol.30)
pp: 617-631
Jiaya Jia , IEEE
ABSTRACT
The aim of this paper is to achieve seamless imagestitching without producing visual artifact caused by severeintensity discrepancy and structure misalignment, given that theinput images are roughly aligned or globally registered. Our newapproach is based on structure deformation and propagation forachieving overall consistency in image structure and intensity.The new stitching algorithm, which has found applications inimage compositing, image blending, and intensity correction,consists of the following main processes. Depending on thecompatibility and distinctiveness of the 2-D features detected inthe image plane, single or double optimal partitions are computedsubject to the constraints of intensity coherence and structurecontinuity. Afterwards, specific 1-D features are detected alongthe computed optimal partitions, from which a set of sparsedeformation vectors is derived to encode 1-D feature matchingbetween the partitions. These sparse deformation cues are robustlypropagated into the input images by solving the associatedminimization problem in gradient domain, thus providing auniform framework for the simultaneous alignment of imagestructure and intensity. We present results in general imagecompositing and blending, in order to show the effectiveness ofour method in producing seamless stitching results from complexinput images.
INDEX TERMS
Image stitching, structure deformation, image alignment
CITATION
Jiaya Jia, Chi-Keung Tang, "Image Stitching Using Structure Deformation", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.30, no. 4, pp. 617-631, April 2008, doi:10.1109/TPAMI.2007.70729
REFERENCES
[1] A. Agarwala, M. Dontcheva, M. Agrawala, S. Drucker, A. Colburn, B. Curless, D. Salesin, and M. Cohen, “Interactive Digital Photomontage,” Proc. ACM SIGGRAPH '04, vol. 23, no. 3, pp. 294-302, 2004.
[2] B. Aronov, R. Seidel, and D.L. Souvaine, “On Compatible Triangulations of Simple Polygons,” Computational Geometry: Theory and Applications, pp. 27-35, 1993.
[3] R. Bajcsy and S. Kovacic, “Multiresolution Elastic Matching,” Computer Vision, Graphics and Image Processing, vol. 46, pp. 1-21, 1989.
[4] M. Brown and D.G. Lowe, “Recognising Panoramas,” Proc. Int'l Conf. Computer Vision, pp. 1218-1225, 2003.
[5] M. Brown, R. Szeliski, and S. Winder, “Multi-Image Matching Using Multi-Scale Oriented Patches,” Proc. Int'l Conf. Computer Vision and Pattern Recognition, pp. 510-517, 2005.
[6] P.J. Burt and E.H. Adelson, “A Multiresolution Spline with Applications to Image Mosaics,” ACM Trans. Graphics, vol. 2, no. 4, pp. 217-236, Oct. 1983.
[7] M.-H. Chen, Q.-M. Shao, and J.G. Ibrahim, Monte Carlo Methods in Bayesian Computation. Springer, 2000.
[8] C. Davatzikos, J.L. Prince, and R.N. Bryan, “Image Registration Based on Boundary Mapping,” IEEE Trans. Medical Imaging, vol. 15, pp. 112-115, 1996.
[9] J. Davis, “Mosaics of Scenes with Moving Objects,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 1998.
[10] E.W. Dijkstra, “A Note on Two Problems in Connexion with Graphs,” Numerische Mathematik, vol. 1, 1959.
[11] A.A. Efros and W.T. Freeman, “Image Quilting for Texture Synthesis and Transfer,” Proc. ACM SIGGRAPH '01, pp. 341-346, Aug. 2001.
[12] D. Eppstein, “The Farthest Point Delaunay Triangulation Minimizes Angles,” CGTA: Computational Geometry: Theory and Applications, vol. 1, 1992.
[13] H. Fang and J.C. Hart, “Textureshop: Texture Synthesis as a Photograph Editing Tool,” Proc. ACM SIGGRAPH '04, 2004.
[14] M. Fornefett, K. Rohr, and H.S. Stiehl, “Radial Basis Functions with Compact Support for Elastic Registration of Medical Images,” Image and Vision Computing, vol. 19, pp. 87-96, 2001.
[15] C. Harris and M.J. Stephens, “A Combined Corner and Edge Detector,” Proc. Alvey Vision Conf., pp. 147-152, 1988.
[16] D. Hasler and S. Susstrunk, “Colour Handling in Panoramic Photography,” Proc. SPIE, Jan. 2001.
[17] J. Jia and C.-K. Tang, “Image Registration with Global and Local Luminance Alignment,” Proc. Int'l Conf. Computer Vision, vol. I, pp. 156-163, 2003.
[18] J. Jia and C.-K. Tang, “Eliminating Structure and Intensity Misalignment in Image Stitching,” Proc. Int'l Conf. Computer Vision, vol. II, pp. 1651-1658, 2005.
[19] J. Jia and C.-K. Tang, “Tensor Voting for Image Correction by Global and Local Intensity Alignment,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 1, pp. 36-50, Jan. 2005.
[20] V. Kwatra, A. Schodl, I. Essa, G. Turk, and A. Bobick, “Graphcut Textures: Image and Video Synthesis Using Graph Cuts,” ACM Trans. Graphics, Proc. Int'l Conf. Computer Graphics and Interactive Techniques (SIGGRAPH '03), vol. 22, no. 3, pp. 277-286, July 2003.
[21] H. Lester and S.R. Arridge, “Summarising Fluid Registration by Thin-Plate Spline Warps with Many Landmarks,” Proc. Medical Image Understanding and Analysis, 1997.
[22] A. Levin, A. Zomet, S. Peleg, and Y. Weiss, “Seamless Image Stitching in the Gradient Domain,” Proc. European Conf. Computer Vision, May 2004.
[23] D.G. Lowe, “Distinctive Image Features from Scale-Invariant Keypoints,” Int'l J. Computer Vision, vol. 60, no. 2, pp. 90-110, 2004.
[24] K. Mikolajczyk and C. Schmid, “Indexing Based on Scale Invariant Interest Points,” Proc. Int'l Conf. Computer Vision, vol. I, pp. 525-531, 2001.
[25] K. Mikolajczyk, T. Tuytelaars, C. Schmid, A. Zisserman, J. Matas, F. Schaffalitzky, T. Kadir, and L. Van Gool, “A Comparison of Affine Region Detectors,” Int'l J. Computer Vision, vol. 65, no. 1/2, pp. 43-72, 2005.
[26] B.-N. Morten and C. Gramkow, “Fast Fluid Registration of Medical Images,” Proc. Visualization in Biomedical Computing, vol. 1131, pp. 267-276, 1996.
[27] P. Pérez, M. Gangnet, and A. Blake, “Poisson Image Editing,” ACM Trans. Graphics, Proc. ACM SIGGRAPH '03, vol. 22, no. 3, pp. 313-318, 2003.
[28] K. Rohr, H.S. Stiehl, R. Sprengel, T.M. Buzug, J. Weese, and M.H. Kuhn, “Landmark-Based Elastic Registration Using Approximating Thin-Plate Splines,” IEEE Trans. Medical Imaging, vol. 20, no. 6, pp. 526-534, 2001.
[29] D. Ruprecht and H. Müller, “Image Warping with Scattered Data Interpolation,” IEEE Computer Graphics and Applications, vol. 15, 1995.
[30] P. Sand and S. Teller, “Video Matching,” ACM Trans. Graphics, vol. 23, no. 3, pp. 592-599, 2004.
[31] D.L. Souvaine and R. Wenger, “Constructing Piecewise Linear Homeomorphisms,” DIMACS Technical Report 94-52, Rutgers Univ., 1994.
[32] R. Szeliski, “Video Mosaics for Virtual Environments,” IEEE Computer Graphics and Applications, pp. 22-30, Mar. 1996.
[33] R. Szeliski, “Image Alignment and Stitching: A Tutorial,” Technical Report MSR-TR-2004-92, Microsoft Research, Dec. 2004.
[34] R. Szeliski and H.-Y. Shum, “Construction of Panoramic Image Mosaics with Global and Local Alignment,” Int'l J. Computer Vision, vol. 36, no. 2, pp. 101-130, 2000.
[35] A. Tal and G. Elber, “Image Morphing with Feature Preserving Texture,” Proc. Conf. European Assoc. for Computer Graphics, pp.339-348, 1999.
[36] M. Uyttendaele, A. Eden, and R. Szeliski, “Eliminating Ghosting and Exposure Artifacts in Image Mosaics,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001.
[37] Q. Wu and Y. Yu, “Feature Matching and Deformation for Texture Synthesis,” Proc. ACM SIGGRAPH '04, vol. 23, no. 3, pp. 362-365, 2004.
19 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool