The Community for Technology Leaders
Subscribe
Issue No.03 - March (2013 vol.35)
pp: 1
Chiwoo Park , Dept. of Ind. & Manuf. Eng., Florida State Univ., Tallahassee, FL, USA
J. Z. Huang , Dept. of Stat., Texas A&M Univ., College Station, TX, USA
J. X. Ji , Dept. of Stat., Texas A&M Univ., College Station, TX, USA
Yu Ding , Dept. of Stat., Texas A&M Univ., College Station, TX, USA
ABSTRACT
This paper presents a method that enables automated morphology analysis of partially overlapping nanoparticles in electron micrographs. In the undertaking of morphology analysis, three tasks appear necessary: separate individual particles from an agglomerate of overlapping nano-objects; infer the particle's missing contours; and ultimately, classify the particles by shape based on their complete contours. Our specific method adopts a two-stage approach: the first stage executes the task of particle separation, and the second stage conducts simultaneously the tasks of contour inference and shape classification. For the first stage, a modified ultimate erosion process is developed for decomposing a mixture of particles into markers, and then, an edge-to-marker association method is proposed to identify the set of evidences that eventually delineate individual objects. We also provided theoretical justification regarding the separation capability of the first stage. In the second stage, the set of evidences become inputs to a Gaussian mixture model on B-splines, the solution of which leads to the joint learning of the missing contour and the particle shape. Using twelve real electron micrographs of overlapping nanoparticles, we compare the proposed method with seven state-of-the-art methods. The results show the superiority of the proposed method in terms of particle recognition rate.
INDEX TERMS
Shape, Nanoparticles, Morphology, Image segmentation, Image edge detection, Splines (mathematics), Electronic countermeasures, shape analsyis, Shape, Nanoparticles, Morphology, Image segmentation, Image edge detection, Splines (mathematics), Electronic countermeasures, contour inference, nano image processing, image segmentation
CITATION
Chiwoo Park, J. Z. Huang, J. X. Ji, Yu Ding, "Segmentation, Inference and Classification of Partially Overlapping Nanoparticles", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 3, pp. 1, March 2013, doi:10.1109/TPAMI.2012.163
REFERENCES
 [1] Z.L. Wang, J.M. Petroski, T.C. Green, and M.A. El-Sayed, "Shape Transformation and Surface Melting of Cubic and Tetrahedral Platinum Nanocrystals," The J. Physical Chemistry B, vol. 102, no. 32, pp. 6145-6151, 1998. [2] M.A. El-Sayed, "Some Interesting Properties of Metals Confined in Time and Nanometer Space of Different Shapes," Accounts of Chemical Research, vol. 34, no. 4, pp. 257-264, 2001. [3] C.L. Nehl, H. Liao, and J.H. Hafner, "Optical Properties of Star-Shaped Gold Nanoparticles," Nano Letters, vol. 6, no. 4, pp. 683-688, 2006. [4] Y. Pan, S. Neuss, A. Leifert, M. Fischler, F. Wen, U. Simon, G. Schmid, W. Brandau, and W. Jahnen-Dechent, "Size-Dependent Cytotoxicity of Gold Nanoparticles," Small, vol. 3, no. 11, pp. 1941-1949, 2007. [5] M. Wortis, Chemistry and Physics of Solid Surfaces. Springer-Verlag, 1988. [6] A. McFarland and R. Van Duyne, "Single Silver Nanoparticles as Real-Time Optical Sensors with Zeptomole Sensitivity," Nano Letters, vol. 3, no. 8, pp. 1057-1062, 2003. [7] O. Glotov, "Image Processing of the Fractal Aggregates Composed of Nanoparticles," Russian J. Physical Chemistry A, Focus on Chemistry, vol. 82, no. 13, pp. 2213-2218, 2008. [8] L.C. Chen and C.C. Ho, "Development of Nanoparticle Shape Measurement and Analysis for Process Characterization of $TiO_2$ Nanoparticle Synthesis," Rev. Advanced Material Science, vol. 18, no. 8, pp. 677-684, 2008. [9] R. Fisker, J. Carstensen, M. Hansen, F. Bødker, and S. Mørup, "Estimation of Nanoparticle Size Distributions by Image Analysis," J. Nanoparticle Research, vol. 2, no. 3, pp. 267-277, 2000. [10] N. Malpica, C. de Solórzano, J. Vaquero, A. Santos, I. Vallcorba, J. García-Sagredo, and F. del Pozo, "Applying Watershed Algorithms to the Segmentation of Clustered Nuclei," Cytometry Part A, vol. 28, no. 4, pp. 289-297, 1997. [11] F. Tek, A. Dempster, and I. Kale, "Blood Cell Segmentation Using Minimum Area Watershed and Circle Radon Transformations," Math. Morphology: 40 Years On, vol. 30, pp. 441-454, 2005. [12] P. Umesh Adiga and B. Chaudhuri, "An Efficient Method Based on Watershed and Rule-Based Merging for Segmentation of 3-D Histo-Pathological Images," Pattern Recognition, vol. 34, no. 7, pp. 1449-1458, 2001. [13] G. Lin, M. Chawla, K. Olson, J. Guzowski, C. Barnes, and B. Roysam, "Hierarchical, Model-Based Merging of Multiple Fragments for Improved Three-Dimensional Segmentation of Nuclei," Cytometry Part A, vol. 63, no. 1, pp. 20-33, 2005. [14] J. Cheng and J. Rajapakse, "Segmentation of Clustered Nuclei with Shape Markers and Marking Function," IEEE Trans. Biomedical Eng., vol. 56, no. 3, pp. 741-748, Mar. 2009. [15] O. Schmitt and M. Hasse, "Morphological Multiscale Decomposition of Connected Regions with Emphasis on Cell Clusters," Computer Vision and Image Understanding, vol. 113, no. 2, pp. 188-201, 2009. [16] J. Shi and J. Malik, "Normalized Cuts and Image Segmentation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 888-905, Aug. 2000. [17] P. Felzenszwalb and D. Huttenlocher, "Efficient Graph-Based Image Segmentation," Int'l J. Computer Vision, vol. 59, no. 2, pp. 167-181, 2004. [18] O. Daněk, P. Matula, C. Ortiz-De-Solórzano, A. Muñoz-Barrutia, M. Maška, and M. Kozubek, "Segmentation of Touching Cell Nuclei Using a Two-Stage Graph Cut Model," Proc. 16th Scandinavian Conf. Analysis, pp. 410-419, 2009. [19] P. Bamford and B. Lovell, "Unsupervised Cell Nucleus Segmentation with Active Contours," Signal Processing, vol. 71, no. 2, pp. 203-213, 1998. [20] S. Nath, K. Palaniappan, and F. Bunyak, "Cell Segmentation Using Coupled Level Sets and Graph-Vertex Coloring," Proc. Ninth Int'l Conf. Image Computing and Computer-Assisted Intervention, pp. 101-108, 2006. [21] M. Kass, A. Witkin, and D. Terzopoulos, "Snakes: Active Contour Models," Int'l J. Computer Vision, vol. 1, no. 4, pp. 321-331, 1988. [22] T. Chan and L. Vese, "Active Contours without Edges," IEEE Trans. Image Processing, vol. 10, no. 2, pp. 266-277, Feb. 2001. [23] L. Vese and T. Chan, "A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model," Int'l J. Computer Vision, vol. 50, no. 3, pp. 271-293, 2002. [24] Y. Chen, H. Tagare, S. Thiruvenkadam, F. Huang, D. Wilson, K. Gopinath, R. Briggs, and E. Geiser, "Using Prior Shapes in Geometric Active Contours in a Variational Framework," Int'l J. Computer Vision, vol. 50, no. 3, pp. 315-328, 2002. [25] A. Foulonneau, P. Charbonnier, and F. Heitz, "Multi-Reference Shape Priors for Active Contours," Int'l J. Computer Vision, vol. 81, no. 1, pp. 68-81, 2009. [26] F. Lecumberry, A. Pardo, and G. Sapiro, "Simultaneous Object Classification and Segmentation with High-Order Multiple Shape Models," IEEE Trans. Image Processing, vol. 19, no. 3, pp. 625-635, Mar. 2010. [27] E. Hodneland, X. Tai, and H. Gerdes, "Four-Color Theorem and Level Set Methods for Watershed Segmentation," Int'l J. Computer Vision, vol. 82, no. 3, pp. 264-283, 2009. [28] Y. Zhang and B. Matuszewski, "Multiphase Active Contour Segmentation Constrained by Evolving Medial Axes," Proc. 16th IEEE Int'l Conf. Image Processing, pp. 2993-2996, 2009. [29] L. Ng and L. Ibanez, "Narrow Band to Image Registration in the Insight Toolkit," Biomedical Image Registration, vol. 2717, pp. 271-280, 2003. [30] M. Marcuzzo, P. Quelhas, A. Mendonça, and A. Campilho, "Evaluation of Symmetry Enhanced Sliding Band Filter for Plant Cell Nuclei Detection in Low Contrast Noisy Fluorescent Images," Proc. Int'l Conf. Analysis and Recognition, pp. 824-831, 2009. [31] P. Quelhas, M. Marcuzzo, A.M. Mendonca, and A. Campilho, "Cell Nuclei and Cytoplasm Joint Segmentation Using the Sliding Band Filter," IEEE Trans. Medical Imaging, vol. 29, no. 8, pp. 1463-1473, Aug. 2010. [32] B. Parvin, Q. Yang, J. Han, H. Chang, B. Rydberg, and M. Barcellos-Hoff, "Iterative Voting for Inference of Structural Saliency and Characterization of Subcellular Events," IEEE Trans. Image Processing, vol. 16, no. 3, pp. 615-623, Mar. 2007. [33] G. Matheron, Random Sets and Integral Geometry. Wiley, 1975. [34] P. Qiu and J. Sun, "Local Smoothing Image Segmentation for Spotted Microarray Images," J. Am. Statistical Assoc., vol. 102, pp. 1129-1144, 2007. [35] P. Qiu and J. Sun, "Using Conventional Edge Detectors and Post-Smoothing for Segmentation of Spotted Microarray Images," J. Computational and Graphical Statistics, vol. 18, pp. 147-1644, 2009. [36] E. Dougherty, Digital Image Processing Methods. CRC, 1994. [37] R.C. Gonzalez and R.E. Woods, Digital Image Processing, third ed. Prentice Hall, 2002. [38] R. Schneider, Convex Bodies: The Brunn-Minkowski Theory. Cambridge Univ. Press, 1993. [39] C. Ronse, "A Bibliography on Digital and Computational Convexity (1961-1988)," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 2, pp. 181-190, Feb. 1989. [40] A. Rosenfeld, "Measuring the Sizes of Concavities," Pattern Recognition Letters, vol. 3, no. 1, pp. 71-75, 1985. [41] E. Bengtsson, C. Wahlby, and J. Lindblad, "Robust Cell Image Segmentation Methods," Pattern Recognition and Image Analysis, vol. 14, no. 2, pp. 157-167, 2004. [42] J. Hoschek, "Intrinsic Parametrization for Approximation," Computer Aided Geometric Design, vol. 5, no. 1, pp. 27-31, 1988. [43] A. Goshtasby, "Grouping and Parameterizing Irregularly Spaced Points for Curve Fitting," ACM Trans. Graphics, vol. 19, no. 3, pp. 185-203, 2000. [44] E. Saux and M. Daniel, "An Improved Hoschek Intrinsic Parametrization," Computer Aided Geometric Design, vol. 20, nos. 8/9, pp. 513-521, 2003. [45] X. Meng and D. Rubin, "Maximum Likelihood Estimation via the ECM Algorithm: A General Framework," Biometrika, vol. 80, no. 2, pp. 267-278, 1993. [46] C. Park, "Automate Morphology Analysis of Nanoparticles," PhD dissertation, Texas A&M Univ., 2011. [47] A. Dempster, N. Laird, and D. Rubin, "Maximum Likelihood from Incomplete Data via the EM Algorithm," J. Royal Statistical Soc., Series B, vol. 39, no. 1, pp. 1-38, 1977. [48] J. Tignol, Galois' Theory of Algebraic Equations. World Scientific Pub Co., Inc., 2001. [49] M. Epstein, "On the Influence of Parametrization in Parametric Interpolation," SIAM J. Numerical Analysis, vol. 13, no. 2, pp. 261-268, 1976. [50] E. Lee, "Choosing Nodes in Parametric Curve Interpolation," Computer-Aided Design, vol. 21, no. 6, pp. 363-370, 1989. [51] C.B. Barber, D. Dobkin, and H. Huhdanpaa, "The Quickhull Algorithm for Convex Hulls," ACM Trans. Math. Software, vol. 22, no. 4, pp. 469-483, 1996. [52] R. Wu, "Rex's Tribe of Image Processing at http://sites.google. com/siterexstribeofimageprocessing /," 2004. [53] N. Otsu, "A Threshold Selection Method from Gray-Level Histograms," IEEE Trans. Systems, Man, and Cybernetics, vol. SMC-9, no. 1, pp. 62-66, Jan. 1979. [54] J. Canny, "A Computational Approach to Edge Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 6, pp. 679-698, Nov. 1986. [55] Z. Tu, S. Zheng, and A. Yuille, "Shape Matching and Registration by Data-Driven EM," Computer Vision and Image Understanding, vol. 109, no. 3, pp. 290-304, 2008. [56] Y. Kim, H. Kim, C. Park, T. Park, J. Kim, Y. Choi, Y. Kim, K. Lee, and C. Kang, "Morphological Analysis of Cells by Scanning Electron Microscopy," Japanese J. Applied Physics-Part 1 Regular Papers and Short Notes, vol. 47, no. 2, pp. 1325-1328, 2008. [57] A. Pinidiyaarachchi and C. Wahlby, "Seeded Watersheds for Combined Segmentation and Tracking of Cells," Proc. 13th Int'l Conf. Image Analysis and Processing, pp. 336-343, 2005. [58] S. Al-Thyabat and N. Miles, "An Improved Estimation of Size Distribution from Particle Profile Measurements," Powder Technology, vol. 166, no. 3, pp. 152-160, 2006. [59] W. Wang, "Image Analysis of Size and Shape of Mineral Particles," Proc. Fourth Int'l Conf. Fuzzy Systems and Knowledge Discovery, vol. 4, pp. 41-44, 2007.