This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Object-Based Image Analysis Using Multiscale Connectivity
June 2005 (vol. 27 no. 6)
pp. 892-907
This paper introduces a novel approach for image analysis based on the notion of multiscale connectivity. We use the proposed approach to design several novel tools for object-based image representation and analysis which exploit the connectivity structure of images in a multiscale fashion. More specifically, we propose a nonlinear pyramidal image representation scheme, which decomposes an image at different scales by means of multiscale grain filters. These filters gradually remove connected components from an image that fail to satisfy a given criterion. We also use the concept of multiscale connectivity to design a hierarchical data partitioning tool. We employ this tool to construct another image representation scheme, based on the concept of component trees, which organizes partitions of an image in a hierarchical multiscale fashion. In addition, we propose a geometrically-oriented hierarchical clustering algorithm which generalizes the classical single-linkage algorithm. Finally, we propose two object-based multiscale image summaries, reminiscent of the well-known (morphological) pattern spectrum, which can be useful in image analysis and image understanding applications.

[1] U.M. Braga-Neto and J. Goutsias, “Multiresolution Connectivity: An Axiomatic Approach,” Math. Morphology and its Applications to Image and Signal Processing, J. Goutsias, L. Vincent, and D.S. Bloomberg, eds., pp. 159-168, 2000.
[2] U.M. Braga-Neto and J. Goutsias, “A Multiscale Approach to Connectivity,” Computer Vision and Image Understanding, vol. 89, pp. 70-107, 2003.
[3] Image Analysis and Mathematical Morphology. Volume 2: Theoretical Advances, J. Serra, ed. London: Academic Press, 1988.
[4] J. Serra, “Connectivity on Complete Lattices,” J. Math. Imaging and Vision, vol. 9, pp. 231-251, 1998.
[5] J. Goutsias and H.J.A.M. Heijmans, “Nonlinear Multiresolution Signal Decomposition Schemes— Part I: Morphological Pyramids,” IEEE Trans. Image Processing, vol. 9, pp. 1862-1876, 2000.
[6] M. Kunt, A. Ikonomopoulos, and M. Kocher, “Second Generation Image Coding Techniques,” Proc. IEEE, vol. 73, pp. 549-574, 1985.
[7] P. Salembier and M. Pardàs, “Hierarchical Morphological Segmentation for Image Sequence Coding,” IEEE Trans. Image Processing, vol. 3, pp. 639-651, 1994.
[8] L.M. Lifshitz and S.M. Pizer, “A Multiresolution Hierarchical Approach to Image Segmentation Based on Intensity Extrema,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, pp. 529-540, 1990.
[9] A. Jain and R. Dubes, Algorithms for Clustering Data. Englewood Cliffs, N.J.: Prentice Hall, 1988.
[10] R.O. Duda, P.E. Hart, and D.G. Stork, Pattern Classification, second ed. New York: John Wiley, 2001.
[11] R. Dubes and A.K. Jain, “Clustering Techniques: The User's Dilemma,” Pattern Recognition, vol. 8, pp. 247-260, 1976.
[12] R. Wilson and G. Walter, “A New Approach to Clustering,” Pattern Recognition, vol. 23, pp. 1413-1425, 1990.
[13] Y.-F. Wong, “Clustering Data by Melting,” Neural Computation, vol. 5, pp. 89-104, 1993.
[14] S.V. Chakravarthy and J. Ghosh, “Scale-Based Clustering Using the Radial Basis Function Network,” IEEE Trans. Neural Networks, vol. 7, pp. 1250-1261, 1996.
[15] S.J. Roberts, “Parametric and Non-Parametric Unsupervised Cluster Analysis,” Pattern Recognition, vol. 30, pp. 261-272, 1997.
[16] Y. Leung, J.-S. Zhang, and Z.-B. Xu, “Clustering by Scale-Space Filtering,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, pp. 1396-1410, 2000.
[17] P.H. Sneath, “Computers in Taxonomy,” J. General Microbiology, vol. 17, pp. 201-226, 1957.
[18] J.C. Gower and G.J.S. Ross, “Minimum Spanning Trees and Single Linkage Cluster Analysis,” Applied Statistics, vol. 18, pp. 54-64, 1969.
[19] R. Sibson, “SLINK: An Optimally Efficient Algorithm for the Single-Link Cluster Method,” The Computer J., vol. 16, pp. 30-34, 1973.
[20] U.M. Braga-Neto and J. Goutsias, “Constructing Multiscale Connectivities,” to be published in Computer Vision and Image Understanding, 2005.
[21] P. Maragos, “Pattern Spectrum and Multiscale Shape Representation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, pp. 701-716, 1989.
[22] J. Serra, “Connections for Sets and Functions,” Fundamental Informaticae, vol. 41, pp. 147-186, 2000.
[23] U.M. Braga-Neto and J. Goutsias, “Grayscale Level Connectivity: Theory and Applications,” IEEE Trans. Image Processing, vol. 12, pp. 1567-1580, 2004.
[24] L. Vincent, “Morphological Grayscale Reconstruction in Image Analysis: Applications and Efficient Algorithms,” IEEE Trans. Image Processing, vol. 2, no. 4, pp. 176-201, 1993.
[25] P. Salembier and J. Serra, “Flat Zones Filtering, Connected Operators, and Filters by Reconstruction,” IEEE Trans. Image Processing, vol. 4, no. 8, pp. 1153-1160, 1995.
[26] P. Soille, Morphological Image Analysis: Principles and Applications. Berlin: Springer, 1999.
[27] H.J.A.M. Heijmans, “Connected Morphological Operators for Binary Images,” Computer Vision and Image Understanding, vol. 73, no. 1, pp. 99-120, 1999.
[28] R. Jones, “Connected Filtering and Segmentation Using Component Trees,” Computer Vision and Image Understanding, vol. 75, pp. 215-228, 1999.
[29] U.M. Braga-Neto, “Connectivity in Image Processing and Analysis: Theory, Multiscale Extensions, and Applications,” PhD thesis, Center for Imaging Science and Dept. of Electrical and Computer Eng., The Johns Hopkins Univ., 2001.
[30] C.S. Tzafestas and P. Maragos, “Shape Connectivity: Multiscale Analysis and Application to Generalized Granulometries,” J. Math. Imaging and Vision, vol. 17, pp. 109-129, 2002.
[31] G. Matheron, Random Sets and Integral Geometry. New York: John Wiley, 1975.
[32] H.J.A.M. Heijmans, Morphological Image Operators. Boston: Academic Press, 1994.
[33] E.R. Dougherty and Y. Cheng, “Morphological Pattern-Spectrum Classification of Noisy Shapes: Exterior Granulometries,” Pattern Recognition, vol. 28, pp. 81-98, 1995.
[34] K. Sivakumar and J. Goutsias, “Discrete Morphological Size Distributions and Densities: Estimation Techniques and Applications,” J. Electronic Imaging, vol. 6, pp. 31-53, 1997.
[35] K. Sivakumar and J. Goutsias, “Morphologically Constrained GRFs: Applications to Texture Synthesis and Analysis,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, pp. 99-113, 1999.
[36] U.M. Braga-Neto and J. Goutsias, “Connectivity on Complete Lattices: New Results,” Computer Vision and Image Understanding, vol. 85, pp. 22-53, 2002.
[37] C. Ronse, “Set-Theoretical Algebraic Approaches to Connectivity in Continuous or Digital Spaces,” J. Math. Imaging and Vision, vol. 8, pp. 41-58, 1998.
[38] U.M. Braga-Neto and J. Goutsias, “A Theoretical Tour of Connectivity in Image Processing and Analysis,” J. Math. Imaging and Vision, vol. 19, pp. 5-31, 2003.
[39] J. Crespo, J. Serra, and R.W. Schafer, “Theoretical Aspects of Morphological Filters by Reconstruction,” Signal Processing, vol. 47, pp. 201-225, 1995.
[40] M.-H. Chen and P.-F. Yan, “A Multiscaling Approach Based on Morphological Filtering,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, pp. 694-700, 1989.
[41] R.W. Brockett and P. Maragos, “Evolution Equations for Continuous-Scale Morphological Filtering,” IEEE Trans. Signal Processing, vol. 42, pp. 3377-3386, 1994.
[42] R. van den Boomgaard and A. Smeulders, “The Morphological Structure of Images: The Differential Equations of Morphological Scale-Space,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, pp. 1101-1113, 1994.
[43] P.T. Jackway and M. Deriche, “Scale-Space Properties of the Multiscale Morphological Dilation-Erosion,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, pp. 38-51, 1996.
[44] H.J.A.M. Heijmans and R. van den Boomgaard, “Algebraic Framework for Linear and Morphological Scale-Spaces,” J. Visual Comm. and Image Representation, vol. 13, pp. 269-301, 2002.
[45] S.G. Mallat, “A Theory for Multiresolution Signal Decomposition: The Wavelet Representation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, pp. 674-693, 1989.
[46] U.M. Braga-Neto, “Multiscale Connected Operators,” to be published in J. Math. Imaging and Vision, special issue on mathematical morphology after 40 years, 2005.
[47] F. Cheng and A.N. Venetsanopoulos, “An Adaptive Morphological Filter for Image Processing,” IEEE Trans. Image Processing, vol. 1, pp. 533-539, 1992.
[48] L. Vincent, “Morphological Area Openings and Closings for Grey-Scale Images,” Shape in Picture: Math. Description of Shape in Grey-Level Lmages, Y.-L. O, A. Toet, D. Foster, H.J.A.M. Heijmans, and P. Meer, eds., pp. 197-208, 1994.
[49] P. Salembier, A. Oliveras, and L. Garrido, “Antiextensive Connected Operators for Image and Sequence Processing,” IEEE Trans. Image Processing, vol. 7, no. 4, pp. 555-570, 1998.

Index Terms:
Connectivity, connection, hierarchical clustering, hierarchical segmentation, mathematical morphology, multiscale image analysis, multiscale image decomposition, object-based image analysis, reconstruction opening.
Citation:
Ulisses Braga-Neto, John Goutsias, "Object-Based Image Analysis Using Multiscale Connectivity," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 6, pp. 892-907, June 2005, doi:10.1109/TPAMI.2005.124
Usage of this product signifies your acceptance of the Terms of Use.