This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Game-Theoretic Integration for Image Segmentation
January 1999 (vol. 21 no. 1)
pp. 12-30

Abstract—Robust segmentation of structures from an image is essential for a variety of image analysis problems. However, the conventional methods of region-based segmentation and gradient-based boundary finding are often frustrated by poor image quality. Here we propose a method to integrate the two approaches using game theory in an effort to form a unified approach that is robust to noise and poor initialization. This combines the perceptual notions of complete boundary information using edge data and shape priors with gray-level homogeneity using two computational modules. The novelty of the method is that this is a bidirectional framework, whereby both computational modules improve their results through mutual information sharing. A number of experiments were performed both on synthetic datasets and datasets of real images to evaluate the new approach and it is shown that the integrated method typically performs better than conventional gradient-based boundary finding.

[1] L. Alvarez, P.L. Lions, and J.M. Morel, “Image Selective Smoothing and Edge Detection by Nonlinear Diffusion,” SIAM J. Numeric Analysis, vol. 29, pp. 845-866, 1992.
[2] A.A. Amini,T.E. Weymouth,, and R.C. Jain,“Using dynamic programming for solving variational problems in vision,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 9, pp. 855-867, 1990.
[3] D.H. Ballard and C.M. Brown, Computer Vision, Prentice Hall, Upper Saddle River, N.J., 1982.
[4] T. Basar, "An Equilibrium Theory for Multiperson Decision Making With Multiple Probabilistic Models," IEEE Trans. Automatic Control, vol. 30, pp. 118-132, 1985.
[5] T. Basar and G.J. Olsder, Dynamic Noncooperative Game Theory.New York: Academic Press, 1982.
[6] J. Besag, "On the Statistical Analysis of Dirty Pictures," J. Royal Statistical Soc., vol. 48, pp. 259-302, 1986.
[7] A. Blake and A. Zisserman, Visual Reconstruction. MIT Press, 1987.
[8] E. Borel, "The Theory of Play and Integral Equations With Skew Symmetrical Kernels. On Games That Involve Chance and Skill of the Players. On Systems of Linear Forms of Skew Symmetric Determinants and the General Theory of Play," Econometrika, vol. 21, pp. 97-117, 1953.
[9] H.I. Bozma, "Decentralized Integration in Modular Systems Using a Game-Theoretic Framework," PhD thesis, Yale Univ., 1992.
[10] H.I. Bozma and J.S. Duncan, "A Modular System for Image Analysis Using a Game Theoretic Framework," Image and Vision Computing, vol. 10, pp. 431-443, 1992.
[11] H.I. Bozma and J.S. Duncan, "A Game-Theoretic Approach to Integration of Modules," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, pp. 1,074-1,086, 1994.
[12] P.J. Burt, T.H. Hong, and A. Rosenfeld, "Segmentation and Estimation of Region Properties Through Co-Operative Hierarchical Computation," IEEE Trans. System, Man, and Cybernetics, vol. 11, pp. 802-809, 1981.
[13] J. Canny, “A Computational Approach to Edge Detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 6, pp. 679-698, June 1986.
[14] V. Caselles, R. Kimmel, and G. Sapiro, “Geodesic Active Contours,” Int'l J. Computer Vision, vol. 22, no. 1, pp. 61-79, 1997.
[15] A. Chakraborty, L.H. Staib, and J.S. Duncan, "Deformable boundary finding influenced by region homogeneity," Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR),Seattle, pp. 624-627, June 1994.
[16] A. Chakraborty, L.H. Staib, and J.S. Duncan, Deformable Boundary Finding in Medical Images by Integrating Gradient and Region Information IEEE Trans. Medical Imaging, vol. 15, pp. 859-870, 1996.
[17] C.-C. Chu and J.K. Aggarwal, "The Integration of Image Segmentation Maps Using Region and Edge Information," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, pp. 1,241-1,252, 1993.
[18] D. Geiger and A. Yuille, "A Common Framework for Image Segmentation," Int'l J. Computer Vision, vol. 6, pp. 227-243, 1991.
[19] D. Geman and S. Geman, "Stochastic Relaxation, Gibbs Distribution and Bayesian Restoration of Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, pp. 721-741, 1984.
[20] J.F. Haddon and J.F. Boyce, "Image Segmentation by Unifying Region and Boundary Information," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, pp. 929-948, 1990.
[21] Y.C. Ho, "Team Decision Theory and Information Structures," Proc. IEEE, vol. 68, pp. 644-654, 1980.
[22] R. Kakarala and A.O. Hero, “On Achievable Accuracy in Edge Localization,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 7, pp. 777-781, 1992.
[23] L.V. Kantorovich and G.P. Akilov, Functional Analysis. Permagon Press, 1982.
[24] M. Kass, A. Witkin, and D. Terzopoulus, "Snakes: Active Contour Models," Int'l J. Computer Vision, vol. 1, pp. 312-331, 1988.
[25] J. Kittler and J. Illingworth, "On Threshold Selection Using Clustering Criteria," IEEE Trans. Systems, Man, and Cybernetics, vol. 15, pp. 652-655, 1985.
[26] R. Kohler, "A Segmentation Based on Thresholding," Computer Vision, Graphics, and Image Processing: Image Understanding, vol. 15, pp. 319-338, 1981.
[27] H.W. Kuhn and A.W. Tucker, eds., Contributions to the Theory of Games, vol. 2, Annals of Mathematics Studies.Princeton, N.J.: Princeton Univ. Press, 1950.
[28] H.W. Kuhn and A.W. Tucker, eds., Contributions to the Theory of Games, vol. 2, Annals of Mathematics Studies.Princeton, N.J.: Princeton Univ. Press, 1953.
[29] Y.G. Leclerc, "Constructing Simple Stable Descriptions for Image Partitioning," Int'l J. Computer Vision, vol. 3, pp. 73-102, 1989.
[30] M.D. Levine and A.M. Nazif, "Dynamic Measurement of Computer Generated Image Segmentation," IEEE Trans. Systems, Man and Cybernetics, vol. 7, pp. 155-164, 1985.
[31] S. Li and T. Basar, "Distributive Algorithms for the Computation of Noncooperative Equilibria," Automatica, vol. 23, pp. 523-533, 1987.
[32] R. Malladi, J. Sethian, and B.C. Vemuri, "Shape Modeling with Front Propagation: A Level Set Approach," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, pp. 158-175, 1995.
[33] B.S. Manjunath and R. Chellappa, “Unsupervised Texture Segmentation Using Markov Random Field Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, pp. 478-482, 1991.
[34] D. Marr and E. Hildreth, "Theory of Edge Detection," Proc. Royal Society, London, vol. B207, pp. 187-217, 1980.
[35] T. McInerney and D. Terzopoulos, "Topologically Adaptable Snakes," Proc. IEEE ICCV-95, pp. 840-845, 1995.
[36] J.C.C. Mckinsey, Introduction to the Theory of Games.New York: McGraw-Hill, 1952.
[37] D. Mumford and J. Shah, "Boundary Detection by Minimizing Functionals," Proc. IEEE Conf. Computer Vision and Pattern Recognition, p. 22, 1985.
[38] J. Von Neumann and O. Morgenstern, Theory of Games and Economic Behavior.Princeton, N.J.: Princeton Univ. Press, 1947.
[39] S. Osher and J.A. Sethian, “Fronts Propagating with Curvature-Dependent Speed: Algorithms Based on Hamilton-Jacobi Formulations,” J. Computing in Physics, vol. 79, pp. 12-49, 1988.
[40] G. Owen, Game Theory.New York: Academic Press, 1982.
[41] T. Pavlidis and Y. Liow,“Integrating region growing and edge detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 3, pp. 225-233, Mar. 1990.
[42] P. Perona and J. Malik, "Scale-Space and Edge Detection Using Anisotropic Diffusion," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 7, pp. 629639, July 1990.
[43] Geometry-Driven Diffusion in Computer Vision, B.M. ter Haar Romeny, ed. Kluwer, 1994.
[44] R. Ronfard, “Region-Based Strategies for Active Contour Models,” Int'l J. Computer Vision, vol. 13, no. 2, 1994.
[45] A. Rosenfeld and A.C. Kak,Digital Picture Processing. Academic Press, 2nd ed., 1982
[46] L.H. Staib and J.S. Duncan, “Boundary Finding with Parametrically Deformable Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 11, pp. 1,061-1,075, Nov. 1992.
[47] T. Taxt,P.J. Flynn,, and A. K. Jain,“Segmentation of document images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 12, pp. 1322-1329, 1989.
[48] H. Tek and B.B. Kimia, Image Segmentation by Reaction-Diffusion Bubbles Proc. Int'l Conf. Computer Vision, pp. 156-162, 1995.
[49] V. Torre and T.A. Poggio, "On Edge Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 2, pp. 147-163, Mar. 1986.
[50] A.K.C. Wong and P.K. Sahoo, "A Gray-Level Thresholding Selection Method Based on Maximum Entropy Principle," IEEE Trans. Systems Man and Cybernetics, vol. 19, pp. 866-871, 1989.
[51] S.C. Zhu, T.S. Lee, and A.L. Yuille, “Region Competition: Unifying Snakes, Region Growing, Energy/Bayes/MDL for Multiband Image Segmentation,” Proc. Fifth IEEE Int'l Conf. Computer Vision (ICCV), pp. 416-423, 1995.
[52] I.G. Zubal and V.J. Caride, "The Technetium-99m-DPTA Renal Uptake-Plasma Volume Product: A Quantitative Estimation of Glomerular Filtration Rate," J. Nuclear Medicine, vol. 33, pp. 1,712-1,716, 1992.

Index Terms:
Image segmentation, integration, game theory, boundary finding, region-based segmentation, MRF.
Citation:
Amit Chakraborty, James S. Duncan, "Game-Theoretic Integration for Image Segmentation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21, no. 1, pp. 12-30, Jan. 1999, doi:10.1109/34.745730
Usage of this product signifies your acceptance of the Terms of Use.