This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Image Editing in the Contour Domain
March 2001 (vol. 23 no. 3)
pp. 291-296

Abstract—Image editing systems are essentially pixel-based. In this paper, we propose a novel method for image editing in which the primitive working unit is not a pixel but an edge. The feasibility of this proposal is suggested by recent work showing that a gray-scale image can be accurately represented by its edge map if a suitable edge model and scale selection method are employed [1]. In particular, an efficient algorithm has been reported to invert such an edge representation to yield a high-fidelity reconstruction of the original image [2], [3]. We have combined these algorithms together with an efficient method for contour grouping and an intuitive user interface to allow users to perform image editing operations (crop, paste, delete) directly in the contour domain. Experimental results suggest that this novel combination of vision algorithms may increase the efficiency of certain classes of image editing operations.

[1] J.H. Elder and S.W. Zucker, Local Scale Control for Edge Detection and Blur Estimation IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 7, pp. 699-716, July 1998.
[2] J.H. Elder and S.W. Zucker, Space Scale Localization, Blur, and Contour-Based Image Coding Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 27-34, June 1996.
[3] J. Elder, “Are Edges Incomplete?,” Int'l J. Computer Vision, vol. 34, no. 2, pp. 97-122, 1999.
[4] K. Koffka, Principles of Gestalt Psychology. New York: Harcourt, Brace&World, 1935.
[5] F. Attneave, “Some Informational Aspects of Visual Perception,” Psychology Rev., vol. 61, no. 3, pp. 183-193, 1954.
[6] D. Hubel and T. Wiesel, “Receptive Fields and Functional Architecture of Monkey Striate Cortex,” J. Neuroscience, vol. 195, pp. 215-243, 1968.
[7] J. Koenderink, “What Does the Occluding Contour Tell Us about Solid Shape?,” Perception, vol. 13, pp. 321-330, 1984.
[8] E. Peterhans and R. von der Heydt, “Mechanisms of Contour Perception in Monkey Visual Cortex. II, Contours Bridging Gaps,” J. Neuroscience, vol. 9, pp. 1749-1763, 1989.
[9] D. Field, A. Hayes, and R. Hess, “Contour Integration by the Human Visual System: Evidence for a Local”Association Field,” Vision Research, vol. 33, no. 2, pp. 173-193, 1993.
[10] J.H. Elder and S.W. Zucker, “Evidence for Boundary-Specific Grouping,” Vision Research, vol. 38, no. 1, pp. 143-152, 1998.
[11] J. Elder and R. Goldberg, “Interactive Contour Editing,” Proc. IEEE Conf. Computer Vision Pattern Recognition, pp. 374-381, June 1998.
[12] J. Elder and S. Zucker, “Local Scale Control for Edge Detection and Blur Estimation,” Proc. Fourth European Conf. Computer Vision, pp. 57-69, 1996.
[13] J. Elder and S. Zucker, “Computing Contour Closure,” Proc. European Conf. Computer Vision, pp. 399-412, 1996.
[14] M. Kass, A. Witkin, and D. Terzopoulos, “Snakes: Active Contour Models,” Proc. Int'l Conf. Computer Vision, vol. 87, pp. 259-268, 1987.
[15] A. Klein, F. Lee, and A. Amini, “Quantitative Coronary Angiography with Deformable Spline Models,” IEEE Trans. Medical Imaging, vol. 16, pp. 468-482, Oct. 1997.
[16] E. Saund and T. Moran, “Perceptual Organization in an Interactive Sketch Editing Application,” Proc. Int'l Conf. Computer Vision, pp. 597-604, 1995.
[17] E. Mortensen and W. Barrett, “Intelligent Scissors for Image Composition,” Proc. SIGGRAPH, pp. 191-198, Aug. 1995.
[18] E. Mortensen and W. Barrett, “Interactive Segmentation with Intelligent Scissors,” Graphical Models and Image Processing, vol. 60, pp. 349-384, Sept. 1998.
[19] E. Mortensen and W. Barrett, “Toboggan-Based Intelligent Scissors with a Four Parameter Edge Model,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 452-458, June 1999.
[20] W.T. Freeman and E.H. Adelson, "The Design and Use of Steerable Filters," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, pp. 891-906, 1991.
[21] P. Perona, "Deformable Kernels for Early Vision," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 5, pp. 488-499, May 1995.
[22] W.H. Press, S.A. Teukolsky, W.T. Vetterling, and B.P. Flannery, Numerical Recipes in C, second ed. Cambridge Univ. Press, 1992.
[23] J. Elder and R. Goldberg, “Inferential Reliability of Contour Grouping Cues in Natural Images,” Perception, vol. 27, p. 11, 1998.
[24] S. Ullman, “Filling-in the Gaps: The Shape of Subjective Contours and a Model for Their Generation,” Biological Cybernetics, vol. 25, pp. 1-6, 1976.
[25] D. Mumford, “Elastic and Computer Vision,” Algebraic Geometry and Applications, C. Bajaj, ed., Heidelberg: Springer-Verlag, 1992.
[26] L. Williams, “Topological Reconstruction of a Smooth Manifold-Solid from Its Occluding Contour,” Int'l J. Computer Vision, vol. 23, no. 1, pp. 93-108, 1997.
[27] L.R. Williams and D.W. Jacobs, “Stochastic Completion Fields: A Neural Model of Illusory Contour Shape and Salience,” Neural Computation, vol. 9, pp. 837-858, 1997.
[28] D.J. Heeger and J.R. Bergen, “Pyramid-Based Texture Analysis/Synthesis,” SIGGRAPH 95 Conf. Proc., R.L. Cook, ed., pp. 229-238, Aug. 1995.
[29] J.S. De Bonet and P. Viola, “Texture Recognition Using a Non-Parametric Multi-Scale Statistical Model,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1998.

Index Terms:
Image editing, edge detection, reconstruction, contour grouping, segmentation.
Citation:
James H. Elder, Richard M. Goldberg, "Image Editing in the Contour Domain," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 3, pp. 291-296, March 2001, doi:10.1109/34.910881
Usage of this product signifies your acceptance of the Terms of Use.