This Article 
 Bibliographic References 
 Add to: 
Morphological Image Compositing
May 2006 (vol. 28 no. 5)
pp. 673-683
Image mosaicking can be defined as the registration of two or more images that are then combined into a single image. Once the images have been registered to a common coordinate system, the problem amounts to the definition of a selection rule to output a unique value for all those pixels that are present in more than one image. This process is known as image compositing. In this paper, we propose a compositing procedure based on mathematical morphology and its marker-controlled segmentation paradigm. Its scope is to position seams along salient image structures so as to diminish their visibility in the output mosaic even in the absence of radiometric corrections or blending procedures. We also show that it is suited to the seamless minimization of undesirable transient objects occurring in the regions where two or more images overlap. The proposed methodology and algorithms are illustrated for the composition of satellite images minimizing cloud cover.

[1] Y. Afek and A. Brand, “Mosaicking of Orthorectified Aerial Images,” Photogrammetric Eng. and Remote Sensing, vol. 64, no. 2, pp. 115-125, Feb. 1998.
[2] A. Agarwala, M. Dontcheva, M. Agrawala, S. Drucker, A. Colburn, B. Curless, D. Salesin, and M. Cohen, “Interactive Digital Photomontage,” ACM Trans. Graphics, vol. 23, no. 3, pp. 294-302, Aug. 2004, , source code and executable: photomontagerelease, 2005.
[3] F. AraújoJr. and N. Leite, “A Morphological Algorithm for Photomosaicking,” Proc. Eighth European Signal Processing Conf. (EURASIP), pp. 181-186, 1996.
[4] S. Bagli and P. Soille, “Automatic Delineation of Shoreline and Lake Boundaries from Landsat Satellite Images,” Proc. Eco-Imagine Conf. GI and GIS for Integrated Coastal Management, 2004, Borsisti/PostersBagli.htm.
[5] C. Ballester, M. Bertalmio, V. Caselles, G. Sapiro, and J. Verdera, “Filling-in by Joint Interpolation of Vector Fields and Gray Levels,” IEEE Trans. Image Processing, vol. 10, no. 8, pp. 1200-1211, Aug. 2001,
[6] M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester, “Image Inpainting,” SIGGRAPH'00: Proc. 27th Ann. Conf. Computer Graphics and Interactive Techniques (SIGGRAPH '00), pp. 417-424, 2000,
[7] C. Bielski and P. Soille, “Order Independent Image Compositing,” Lecture Notes in Computer Science, vol. 3617, pp. 1076-1083, Sept. 2005.
[8] Y. Boykov, O. Veksler, and R. Zabih, “Fast Approximate Energy Minimization via Graph Cuts,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 11, pp. 1222-1239, Nov. 2001,
[9] D. Brunner and P. Soille, “Iterative Area Seeded Region Growing for Multichannel Image Simplification,” Math. Morphology: 40 Years On, C. Ronse, L. Najman, and E. Decencière, eds., Computational Imaging and Vision, vol. 30, pp. 397-406, Dordrecht, The Netherlands: Springer-Verlag, 2005.
[10] P. Burt and E. Adelson, “A Multiresolution Spline with Application to Image Mosaics,” ACM Trans. Graphics, vol. 2, no. 4, pp. 217-236. Oct. 1983,
[11] C.-Y. Chen and R. Klette, “Image Stitching: Comparisons and New Techniques,” Lecture Notes in Computer Science, vol. 1689, pp. 615-622, 1999.
[12] A. Criminisi, P. Pérez, and K. Toyama, “Region Filling and Object Removal by Exemplar-Based Image Inpainting,” IEEE Trans. Image Processing, vol. 13, no. 9, pp. 1200-1212, Sept. 2004.
[13] P. Dani and S. Chaudhuri, “Automated Assembling of Images: Image Montage Preparation,” Pattern Recognition, vol. 28, no. 3, pp. 431-445, Mar. 1995, 0031-3203(94)00106-V .
[14] J. Davis, “Mosaics of Scenes with Moving Objects,” Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '98), pp. 354-360, 1998.
[15] S. Di Zenzo, “A Note on the Gradient of a Multi-Image,” Computer Vision, Graphics, and Image Processing, vol. 33, pp. 116-125, 1986.
[16] E. Dijkstra, “A Note on Two Problems in Connexion with Graphs,” Numerische Mathematik, vol. 1, pp. 269-271, 1959.
[17] A. Efros and W. Freeman, “Image Quilting for Texture Synthesis and Transfer,” Proc. Int'l Conf. Computer Graphics and Interactive Techniques (SIGGRAPH '01), pp. 341-346, Aug. 2001, http://doi. .
[18] H. Heijmans, Morphological Image Operators. Boston: Academic Press, 1994.
[19] S. Hummer-Miller, “A Digital Mosaicking Algorithm Allowing for an Irregular Join ‘Line,’” Photogrammetric Eng. and Remote Sensing, vol. 55, no. 1, Jan. 1989.
[20] M. Irani, P. Anandan, J. Bergen, R. Kumar, and S. Hsu., “Efficient Representations of Video Sequences and Their Applications,” Signal Processing: Image Comm., vol. 8, no. 4, pp. 327-351, Apr. 1996.
[21] V. Kwatra, A. Schödl, I. Essa, G. Turk, and A. Bobick, “Graphcut Textures: Image and Video Synthesis Using Graph Cuts,” ACM Trans. Graphics, vol. 22, no. 3, pp. 277-286, 2003,
[22] A. Levin, A. Zomet, S. Peleg, and Y. Weiss, “Seamless Image Stitching in the Gradient Domain,” Lecture Notes in Computer Science, vol. 3024, pp. 377-389, 2004.
[23] S. Masnou, “Disocclusion: A Variational Approach Using Level Lines,” IEEE Trans. Image Processing, vol. 11, no. 2, pp. 68-76, Feb. 2002,
[24] S. Masnou and J. Morel, “Level Lines Based Disocclusion,” Proc. Int. Conf. Image Processing, vol. 3, pp. 259-263, 1998, .
[25] D. McNeil, “The Wet Process of Laying Mosaics,” Photogrammetric Eng., vol. 15, no. 2, p. 315, 1949.
[26] F. Meyer and S. Beucher, “Morphological Segmentation,” J. Visual Comm. and Image Representation, vol. 1, no. 1, pp. 21-46, Sept. 1990.
[27] D. Milgram, “Computer Methods for Creating Photomosaics,” IEEE Trans. Computers, vol. 24, no. 11, pp. 1113-1119, Nov. 1975.
[28] D. Milgram, “Adaptive Techniques for Photomosaicking,” IEEE Trans. Computers, vol. 26, no. 11, pp. 1175-1180, Nov. 1977.
[29] S. Peleg, “Elimination of Seams from Photomosaics,” Computer Graphics and Image Processing, vol. 16, pp. 90-94, 1981.
[30] T. Porter and T. Duff, “Compositing Digital Images,” Computer Graphics, vol. 18, no. 3, pp. 253-259, July 1984.
[31] R. Sedgewick, Algorithms in C: Fundamentals, Data Structures, Sorting, Searching, and Graph Algorithms. Part 5: Graph Algorithms, third ed. Addison-Wesley, 2001.
[32] J. Serra, Image Analysis and Mathematical Morphology. London: Academic Press, 1982.
[33] P. Soille, “Spatial Distributions from Contour Lines: An Efficient Methodology Based on Distance Transformations,” J. Visual Comm. and Image Representation, vol. 2, no. 2, pp. 138-150, June 1991.
[34] P. Soille, “Generalized Geodesy via Geodesic Time,” Pattern Recognition Letters, vol. 15, no. 12, pp. 1235-1240, Dec. 1994, , download PDF preprint:
[35] P. Soille, “On the Morphological Processing of Objects with Varying Local Contrast,” Lecture Notes in Computer Science, vol. 2886, pp. 52-61, Nov. 2003.
[36] P. Soille, Morphological Image Analysis: Principles and Applications. Berlin and New York: Springer-Verlag, corrected second printing of second ed., 2004.
[37] P. Soille, “Beyond Self-Duality in Morphological Image Analysis,” Image and Vision Computing, vol. 23, no. 2, pp. 249-257, Feb. 2005, .
[38] P. Soille and M. Pesaresi, “Advances in Mathematical Morphology Applied to Geoscience and Remote Sensing,” IEEE Trans. Geoscience and Remote Sensing, vol. 40, no. 9, pp. 2042-2055, Sept. 2002.
[39] P. Soille and H. Talbot, “Directional Morphological Filtering,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 11, pp. 1313-1329, Nov. 2001,
[40] L. Vincent and P. Soille, “Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 6, pp. 583-598, June 1991, .
[41] T. Welch, “A Technique for High Performance Data Compression,” Computer, vol. 17, no. 6, pp. 8-19, June 1984.
[42] P. Wolf, Elements of Photogrammetry (with Air Photo Interpretation and Remote Sensing). New York: McGraw-Hill, 1974.
[43] B. Zitová and J. Flusser, “Image Registration Methods: A Survey,” Image and Vision Computing, vol 21, pp. 997-1000, 2003.

Index Terms:
Mathematical morphology, image compositing, seam, watershed transformation, segmentation, mosaicking, remote sensing.
Pierre Soille, "Morphological Image Compositing," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 5, pp. 673-683, May 2006, doi:10.1109/TPAMI.2006.99
Usage of this product signifies your acceptance of the Terms of Use.