This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Contour Grouping with Prior Models
June 2003 (vol. 25 no. 6)
pp. 661-674

Abstract—Conventional approaches to perceptual grouping assume little specific knowledge about the object(s) of interest. However, there are many applications in which such knowledge is available and useful. Here, we address the problem of finding the bounding contour of an object in an image when some prior knowledge about the object is available. We introduce a framework for combining prior probabilistic knowledge of the appearance of the object with probabilistic models for contour grouping. A constructive search technique is used to compute candidate closed object boundaries, which are then evaluated by combining figure, ground, and prior probabilities to compute the maximum a posteriori estimate. A significant advantage of our formulation is that it rigorously combines probabilistic local cues with important global constraints such as simplicity (no self-intersections), closure, completeness, and nontrivial scale priors. We apply this approach to the problem of computing exact lake boundaries from satellite imagery, given approximate prior knowledge from an existing digital database. We quantitatively evaluate the performance of our algorithm and find that it exceeds the performance of human mapping experts and a competing active contour approach, even with relatively weak prior knowledge. While the priors may be task-specific, the approach is general, as we demonstrate by applying it to a completely different problem: the computation of human skin boundaries in natural imagery.

[1] M. Wertheimer, Laws of Organization in Perceptual Forms A Sourcebook of Gestalt Psychology, W. D. Ellis, ed. pp. 71-88, London: Routledge and Kegan Paul, 1938.
[2] K. Koffka, Principles of Gestalt Psychology. New York: Harcourt, Brace and World, 1935.
[3] G. Kanizsa, Organization in Vision. New York: Praeger, 1979.
[4] S.W. Zucker, K.A. Stevens, and P. Sander, The Relation between Proximity and Brightness Similarity in Dot Patterns Perception and Psychophysics, vol. 34, no. 6, pp. 513-522, 1983.
[5] I. Rock, The Logic of Perception. Cambridge, Mass.: MIT Press, 1983.
[6] P. Cavanagh, What's Up in Top-Down Processing? Representations of Vision: Trends and Tacit Assumptions in Vision Research, A. Gorea, ed. pp. 295-304, Cambridge, U.K.: Cambridge Univ. Press, 1991.
[7] P. Cavanagh, Top-Down Processing in Vision MIT Encyclopedia of Cognitive Science, R.A. Wilson and F.C. Keil, eds. pp. 844-845, Cambridge, Mass.: MIT Press, 1999.
[8] K.S. Rockland, K.S. Salem, and K. Tanaka, Divergent Feedback Connections from Areas V4 and TEO in the Macaque Visual Neuroscience, 1994.
[9] A. Amir and M. Lindenbaum, “A Generic Grouping Algorithm and Its Quantitative Analysis,” IEEE Tran. Pattern Analysis and Machine Intelligence, vol. 20, no. 2, pp. 168-185, Feb. 1998.
[10] D.G. Lowe, Organization of Smooth Image Curves at Multiple Scales Int'l J. Computer Vision, vol. 3, pp. 119-130, 1989.
[11] E. Saund, “Labeling of Curvilinear Structure Across Scales By Token Grouping,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 257-263, 1992.
[12] D.P. Huttenlocher and P.C. Wayner, Finding Convex Edge Groupings in an Image Int'l J. Computer Vision, vol. 8, no. 1, pp. 7-27, 1992.
[13] D.W. Jacobs, Robust and Efficient Detection of Convex Groups Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 770-771, 1993.
[14] I.J. Cox, J.M. Rehg, and S. Hingorani, A Bayesian Multiple-Hypothesis Approach to Edge Grouping and Contour Segmentation Int'l J. Computer Vision, vol. 11, no. 1, pp. 5-24, 1993.
[15] D.W. Jacobs, "Robust and Efficient Detection of Salient Convex Groups," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, pp. 23-37, Jan. 1996.
[16] D. Crevier, A Probabilistic Method for Extracting Chains of Collinear Segments Computer Vision and Image Understanding, vol. 76, no. 1, pp. 36-53, Oct. 1999.
[17] D. Crevier, Bayesian Extraction of Collinear Segment Chains from Digital Images Recent Advances in Perceptual Organization for Artificial Vision Systems, K.L. Boyer and S. Sarkar, eds. pp. 163-171, Kluwer, 2001.
[18] J.H. Elder and S.W. Zucker, Computing Contour Closure Proc. Fourth European Conf. Computer Vision, pp. 399-412, 1996.
[19] S. Mahamud, K. Thornber, and L. Williams, “Segmentation of Salient Closed Contours From Real Images,” Proc. Int'l Conf. Computer Vision, 1999.
[20] U. Montanari, On The Optimal Detection of Curves in Noisy Pictures Comm. ACM, vol. 15, no. 5, pp. 335-345, May 1972.
[21] A. Martelli, An Application of Heuristic Search Methods to Edge and Contour Detection Comm., vol. 19, pp. 73-83, 1976.
[22] P. Parent and S.W. Zucker, “Trace Inference, Curvature Consistency and Curve Detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 8, pp. 823-839, 1989.
[23] G. Dudek and J.K. Tsotsos, Recognizing Planar Curves Using Curvature-Tuned Smoothing Proc. 10th Int'l Conf. Pattern Recognition, 1990.
[24] A. Sha'ashua and S. Ullman, “Structural Saliency: The Detection of Globally Salient Structures Using a Locally Connected Network,” Proc. Int'l Conf. Computer Vision, pp. 321-327, 1988.
[25] T.D. Alter, The Role of Saliency and Error Propagation in Visual Object Recognition PhD thesis, Massachusetts Inst. of Tech nology, May 1995.
[26] T. Leung and J. Malik, Contour Continuity in Region Based Image Segmentation Proc. Fifth European Conf. Computer Vision, June 1998.
[27] V. Murino, C.S. Regazzoni, and G.L. Foresti, Grouping as a Searching Process for Minimum-Energy Configurations of Labelled Random Fields Computer Vision and Image Understanding, vol. 64, no. 1, pp. 157-174, 1996.
[28] R.L. Castano and S. Hutchinson, A Probabilistic Approach to Perceptual Grouping Computer Vision and Image Understanding, vol. 64, no. 3, pp. 399-419, Nov. 1996.
[29] L. Williams and D. Jacobs, Stochastic Completion Fields: A Neural Model of Illusory Contour Shape and Salience Proc. Fifth Int'l Conf. Computer Vision, pp. 408-415, 1995.
[30] L. R. Williams and D. W. Jacobs, Stochastic Completion Fields: A Neural Model of Illusory Contour Shape and Salience Neural Computation, vol. 9, no. 4, pp. 837-858, 1997.
[31] M. Lindenbaum and A. Berengolts, A Probabilistic Interpretation of the Saliency Network Proc. European Conf. Computer Vision, vol. II, pp. 257-272, 2000.
[32] J.H. Elder and R.M. Goldberg, Image Editing in the Contour Domain IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 3, pp. 291-296, Mar. 2001.
[33] T.L. Liu and D. Geiger, Visual Deconstruction: Recognizing Articulated Objects Proc. Energy Minimization Methods in Computer Vision and Pattern Recognition, vol. 1223, pp. 295-309, 1997.
[34] E. Brunswik and J. Kamiya, Ecological Cue-Validity of `Proximity' and of Other Gestalt Factors Am. J. Psychology, vol. LXVI, pp. 20-32, 1953.
[35] N. Kruger, Collinearity and Parallelism Are Statistically Significant Second Order Relations of Complex Cell Responses Neural Processing Letters, vol. 8, pp. 117-129, 1998.
[36] J.H. Elder and R.M. Goldberg, The Statistics of Natural Image Contours Proc. IEEE CS Workshop Perceptual Organization in Computer Vision, June 1998. Available fromhttp://research.microsoft.com/~sdumais/cikm98.dochttp:/ /marathon.csee.usf.edu/sarkar pocv_program.html.
[37] J. H. Elder and R. M. Goldberg, Inferential Reliability of Contour Grouping Cues in Natural Images Perception, vol. 27 (supplement), p. 11, Aug. 1998.
[38] J.H. Elder and R.M. Goldberg, Ecological Statistics of Gestalt Laws for the Perceptual Organization of Contours J. Vision, vol. 2, no. 4, pp. 324-353, 2002. http://journalofvision.org/2/4/5/, DOI10.1167 2.4.5.
[39] D. Martin, C. Fowlkes, D. Tal, and J. Malik, A Database of Human Segmented Natural Images and Its Application to Evaluating Segmentation Algorithms and Measuring Ecological Statistics Proc. Eighth Int'l Conf. Computer Vision, pp. 416-424, 2001.
[40] W.S. Geisler, J.S. Perry, B.J. Super, and D.P. Gallogly, Edge Co-Occurence in Natural Images Predicts Contour Grouping Performance Vision Research, vol. 41, no. 6, pp. 711-724, Mar. 2001.
[41] M. Sigman, G.A. Cecchi, C.D. Gilbert, and M.O. Magnasco, On a Common Circle: Natural Scenes and Gestalt Rules Proc. Nat'l Academy of Sciences, 2001.
[42] M. Kaschube, F. Wolf, T. Geisel, and S. Lowel, The Prevalence of Colinear Contours in the Real World Neurocomputing, vols. 38-40, pp. 1335-1339, 2001.
[43] D. Geman and B. Jedynak, An Active Testing Model for Tracking Roads in Satellite Images IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 1, pp. 1-14, Jan. 1996.
[44] A.L. Yuille and J.M. Coughlan, “Fundamental Limits of Bayesian Inference: Order Parameters and Phase Transitions for Road Tracking,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 2, pp. 160-173, Feb. 2000.
[45] M. Cazorla, F. Escolano, D. Gallardo, and R. Rizo, Junction Detection and Grouping with Probabilistic Edge Models and Bayesian a* Pattern Recognition, vol. 35, no. 9, pp. 1869-1881, 2002.
[46] M. Kass, A. Witkin, and D. Terzopoulos, Snakes: Active Contour Models Int'l J. Computer Vision, vol. 1, no. 4, pp. 321-331, 1987.
[47] E.M. Riseman and M.A. Arbib, Computational Techniques in the Visual Segmentation of Static Scenes Computer Graphics and Image Processing, vol. 6, pp. 221-276, 1977.
[48] S.C. Zhu and A. Yuille, “Region Competition: Unifying Snakes, Region Growing and Bayes/MDL for Multiband Image Segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, pp. 884-900, 1996.
[49] C. Chesnaud, P. Réfrégier, and V. Boulet, Statistical Region Snake-Based Segmentation Adapted to Different Physical Noise Models IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, pp. 1145-1157, 1999.
[50] J.H. Elder and S.W. Zucker, The Effect of Contour Closure on the Rapid Discrimination of Two-Dimensional Shapes Vision Research, vol. 33, no. 7, pp. 981-991, 1993.
[51] I. Kovacs and B. Julesz, A Closed Curve Is Much More than an Incomplete One: Effect of Closure in Figure-Ground Discrimination Proc. Nat'l Academy of Science USA, vol. 90, pp. 7495-7497, 1993.
[52] S. Borra and S. Sarkar, “A Framework for Performance Characterization of Intermediate-Level Grouping Modules,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 11, pp. 1,306-1,312, Nov. 1997.
[53] L.R. Williams and K.K. Thornber, A Comparison of Measures for Detecting Natural Shapes in Cluttered Backgrounds Int'l J. Computer Vision, vol. 34, nos. 2/3, pp. 81-96, Sept. 1999.
[54] J.H. Elder and S.W. Zucker, Local Scale Control for Edge Detection and Blur Estimation IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 7, pp. 699-716, July 1998.
[55] S.G. Mallat,“A theory for multiresolution signal decomposition: The wavelet representation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 7, pp. 674-693, 1989.
[56] E.P. Simoncelli and E.H. Adelson, Noise Removal via Bayesian Wavelet Coring Proc. Third IEEE Int'l Conf. Image Processing, pp. 379-382, Sept. 1996.
[57] E.P. Simoncelli, Modeling the Joint Statistics of Images in the Wavelet Domain Proc. SPIE 44th Ann. Meeting, vol. 3813, pp. 188-195, July 1999.
[58] C.E. Shannon and W. Weaver, The Mathematical Theory of Communication. Urbana, Ill.: Univ. of Illinois Press, 1949.
[59] L.D. Cohen, On Active Contour Models and Balloons Computer Vision, Graphics, and Image Processing: Image Understanding, vol. 53, no. 2, pp. 211-218, 1991.
[60] P. Fua, Fast, Accurate and Consistent Modeling of Drainage and Surrounding Terrain Int'l J. Computer Vision, vol. 26, no. 3, pp. 215-234, 1998.
[61] I. Laptev, H. Mayer, T. Lindeberg, W. Eckstein, C. Steger, and A. Baumgartner, Automatic Extraction of Roads from Aerial Images Based on Scale Space and Snakes Machine Vision and Applications, vol. 12, pp. 23-31, 2000.
[62] M.J. Jones and J. M. Rehg, Statistical Color Models with Application to Skin Detection Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1999.

Index Terms:
Perceptual organization, grouping, contours, edges, graph search, Bayesian probabilistic inference, segmentation, remote sensing, skin detection.
Citation:
James H. Elder, Amnon Krupnik, Leigh A. Johnston, "Contour Grouping with Prior Models," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 6, pp. 661-674, June 2003, doi:10.1109/TPAMI.2003.1201818
Usage of this product signifies your acceptance of the Terms of Use.