This Article 
 Bibliographic References 
 Add to: 
Graphical Gaussian Shape Models and Their Application to Image Segmentation
March 2003 (vol. 25 no. 3)
pp. 316-329

Abstract—This paper presents a novel approach to shape modeling and a model-based image segmentation procedure tailor-made for the proposed shape model. A common way to represent shape is based on so-called key points and leads to shape variables, which are invariant with respect to similarity transformations. We propose a graphical shape model, which relies on a certain conditional independence structure among the shape variables. Most often, it is sufficient to use a sparse underlying graph reflecting both nearby and long-distance key point interactions. Graphical shape models allow for specific shape modeling, since, e.g., for the subclass of decomposable graphical Gaussian models both model selection procedures and explicit parameter estimates are available. A further prerequisite to a successful application of graphical shape models in image analysis is provided by the “toolbox” of Markov chain Monte Carlo methods offering highly flexible and effective methods for the exploration of a specified distribution. For Bayesian image segmentation based on a graphical Gaussian shape model, we suggest applying a hybrid approach composed of the well-known Gibbs sampler and the more recent slice sampler. Shape modeling as well as image analysis are demonstrated for the segmentation of vertebrae from two-dimensional slices of computer tomography images.

[1] Y. Amit and U. Grenander, “Comparing Sweep Strategies for Stochastic Relaxation,” J. Multivariate Analysis, vol. 37, pp. 197-222, 1991.
[2] J. Besag, “On the Statistical Analysis of Dirty Pictures,” J. Royal Statistical Soc., Series B, vol. 48, no. 3, pp. 259-302, 1986.
[3] J. Besag and P.J. Green, “Spatial Statistics and Bayesian Computatio,” J. Royal Statistical Soc., Series B, vol. 55, no. 1, pp. 25-37, 1993.
[4] F.L. Bookstein, “Size and Shape Spaces for Landmark Data in Two Dimensions (with discussion),” Statistical Science, vol. 1, no. 2, pp. 181-242, 1986.
[5] J. Canny, “A Computational Approach to Edge Detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 6, pp. 679-698, June 1986.
[6] B. Chalmond, “Image Restoration Using an Estimated Markov Model,” Signal Processing, vol. 15, pp. 115-129, 1988.
[7] T.F. Cootes, C.J. Taylor, D.H. Cooper, and J. Graham, “Image Search Using Trained Flexible Shape Models,” Advances in Applied Statistics, Statistic and Image 2, K.V. Mardia, ed., pp. 111-139, 1994.
[8] G.R. Cross and A.K. Jain, “Markov Random Field Texture Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 5, no. 1, pp. 25-39, 1983.
[9] A.P. Dempster, “Covariance Selection,” Biometrics, vol. 28, pp. 157-175, 1972.
[10] I.L. Dryden and K.V. Mardia, Statistical Shape Analysis. Chichester: John Wiley&Sons, 1998.
[11] R.G. Edwards and A.D. Sokal, “Generalization of the Fortuin-Kasteleyn-Swendsen-Wang Representation and Monte Carlo Algorithm,” Physical Rev. D, vol. 38, no. 6, 1988.
[12] M.T. de Figueiredo and J.M.N. Leitão, “Bayesian Estimation of Ventricular Contours in Angiographic Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 3, pp. 416-429, 1992.
[13] N. Friedland and D. Adam, “Automatic Ventricular Cavity Boundary Detection from Sequential Ultrasound Images Using Simulated Annealing,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 4, pp. 344-353, 1989.
[14] S. Geman and D. Geman, “Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, no. 6, pp. 721-741, 1984.
[15] Y.S. Chow, U. Grenander, and D.M. Keenan, HANDS. A Pattern-Theoretic Study Of Biological Shapes.New York: Springer-Verlag, 1991.
[16] P.J. Green, “Reversible Jump Markov Chain Monte Carlo Computation and Bayesian Model Determination,” Biometrika, vol. 82, no. 4, pp. 711-732, 1995.
[17] D.M. Higdon, “Auxiliary Variable Methods for Markov Chain Monte Carlo With Applications,” J. Am. Statistical Assoc., Theory and Methods, vol. 93, no. 442, pp. 585-595, 1998.
[18] A.K. Jain, Y. Zhong, and M.-P. Dubuisson-Jolly, “Deformable Template Models: A Review,” Signal Processing, vol. 71, no. 2, pp. 109-129, 1998.
[19] D.G. Kendall, “The Diffusion of Shape,” Advances in Applied Probability, vol. 9, pp. 428-430, 1977.
[20] D.G. Kendall, “Shape Manifolds, Procrustean Metrics, and Complex Projective Spaces,” Bull. London Math. Soc., vol. 16, pp. 81-121, 1984.
[21] D.G. Kendall, “A Survey of the Statistical Theory of Shape (with discussion),” Statistical Science, vol. 4, no. 2, pp. 87-120, 1989.
[22] C. Kervrann and F. Heitz, “A Hierarchical Markov Modeling Approach for the Segmentation and Tracking of Deformable Shapes,” Graphical Models and Image Processing, vol. 60, no. 3, pp. 173–195, May 1998.
[23] S.L. Lauritzen, Graphical Models. Oxford: Oxford Univ. Press, 1996.
[24] M. Knuiman, “Covariance Selection,” Advances in Applied Probability, Special Supplement, vol. 10, pp. 123-130, 1978.
[25] N. Krahnstöver and C. Lorenz, “Development of a Point Based Shape Representation of Arbitrary Three-Dimensional Medical Objects Suitable for Statistical Shape Modeling,” Image Processing, Proc. SPIE, K.M. Hanson ed., vol. 3661, pp. 620-631, 1999.
[26] J.L. Marroquin, “Optimal Bayesian Estimators for Image Segmentation and Surface Reconstruction,” Massachusetts Institute of Technology Artificial Intelligence Laboratory, A.I. Memo 839, Apr. 1985.
[27] T. McInerney and D. Terzopoulos, “Deformable Models in Medical Image Analysis: A Survey,” Medical Image Analysis, vol. 1, no. 2, pp. 91-108, 1996.
[28] A. Mira and L. Tierney, “On the Use of Auxiliary Variables in Markov Chain Monte Carlo Sampling,” Technical Report 63 (7-97), Dipartimento di Economia Politica e Metodi Quantitativi, Universitàdegli Studi di Pavia, 1997.
[29] J. Montagnat and H. Delingette, “Globally Constrained Deformable Models for 3D Object Reconstruction,” Signal Processing, vol. 71, no. 2, pp. 173-186, 1998.
[30] A. Neumann, “Graphical Models for Shapes in Images,” Dissertation am Fachbereich Mathematik der Universität Hamburg, Aachen:Shaker Verlag GmbH, Aachen, 2001, (available in electronic form underhttp:/
[31] A. Neumann and C. Lorenz, “Statistical Shape Model Based Segmentation of Medical Images,” Computerized Medical Imaging and Graphics, vol. 22, pp. 133-143, 1998.
[32] A. Neumann and C. Lorenz, “Statistical Shape Description Using Gaussian Markov Random Fields and Its Application to Medical Image Segmentation,” Image Processing Proc. SPIE, K.M. Hanson ed., vol. 3661, pp. 192-203, 1999.
[33] A. Pievatolo and P.J. Green, “Boundary Detection through Dynamic Polygons,” J. Royal Statistical Soc., Series B, vol. 60, part 3, pp. 609-626, 1998.
[34] W.H. Press, S.A. Teukolsky, W.T. Vetterling, and B.P. Flannery, Numerical Recipes in C. Cambridge Univ. Press, 1992.
[35] G.O. Roberts and A.F.M. Smith, “Simple Conditions for the Convergence of the Gibbs Sampler and Metropolis-Hastings Algorithms,” Stochastic Processes and Their Applications, vol. 49, pp. 207-216, 1994.
[36] S.L. Sclove, “Application of Model-Selection Criteria to Some Problems in Multivariate Analysis,” Psychometrika, vol. 52, no. 3, pp. 333-343, 1987.
[37] G. Storvik, "A Bayesian approach to dynamic contours through stochastic sampling and simulated annealing," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 10, pp. 976-986, Oct. 1994
[38] R.H. Swendsen and J.-S. Wang, “Nonuniversal Critical Dynamics in Monte Carlo Simulations,” Physical Rev. Letters, vol. 58, no. 2, pp. 86-88, 1987.
[39] L. Tierney, “Markov Chains for Exploring Posterior Distributions,” The Annals of Statistics, vol. 22, no. 4, pp. 1701-1762, 1994.
[40] N. Wermuth, “Model Search Among Multiplicative Models,” Biometrics, vol. 32, pp. 253-263, 1976.
[41] N. Wermuth, “Linear Recursive Equations, Covariance Selection, and Path Analysis,” J. Am.Statistical Assoc., vol. 75, no. 372, pp. 963-972, 1980.

Index Terms:
Shape, Bookstein coordinates, conditional independence, graphical Gaussian models, Markov random fields, Bayesian image segmentation, Markov chain Monte Carlo sampling methods, Gibbs sampler, slice sampler.
Anke Neumann, "Graphical Gaussian Shape Models and Their Application to Image Segmentation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 3, pp. 316-329, March 2003, doi:10.1109/TPAMI.2003.1182095
Usage of this product signifies your acceptance of the Terms of Use.