This Article 
 Bibliographic References 
 Add to: 
Globally Minimal Surfaces by Continuous Maximal Flows
January 2006 (vol. 28 no. 1)
pp. 106-118
In this paper, we address the computation of globally minimal curves and surfaces for image segmentation and stereo reconstruction. We present a solution, simulating a continuous maximal flow by a novel system of partial differential equations. Existing methods are either grid-biased (graph-based methods) or suboptimal (active contours and surfaces). The solution simulates the flow of an ideal fluid with isotropic velocity constraints. Velocity constraints are defined by a metric derived from image data. An auxiliary potential function is introduced to create a system of partial differential equations. It is proven that the algorithm produces a globally maximal continuous flow at convergence, and that the globally minimal surface may be obtained trivially from the auxiliary potential. The bias of minimal surface methods toward small objects is also addressed. An efficient implementation is given for the flow simulation. The globally minimal surface algorithm is applied to segmentation in 2D and 3D as well as to stereo matching. Results in 2D agree with an existing minimal contour algorithm for planar images. Results in 3D segmentation and stereo matching demonstrate that the new algorithm is robust and free from grid bias.

[1] M. Kass, A. Witkin, and D. Terzopoulos, “Snakes: Active Contour Models,” Int'l J. Computer Vision, vol. 1, no. 4, pp. 321-331, 1998.
[2] S. Osher and J.A. Sethian, “Fronts Propagating with Curvature-Dependent Speed: Algorithms Based on Hamilton-Jacobi Formulations,” J. Computational Physics, vol. 79, pp. 12-49, 1988,
[3] J.A. Sethian, Level Set Methods and Fast Marching Methods— Evolving Interfaces in Computational Geometry, Fluid Mechanics, Computer Vision, and Materials Science. Cambridge Univ. Press, 1999.
[4] V. Caselles, R. Kimmel, and G. Sapiro, “Geodesic Active Contours,” Int'l J. Computer Vision, vol. 22, no. 1, pp. 61-79, 1997.
[5] V. Caselles, R. Kimmel, G. Sapiro, and C. Sbert, “Minimal Surfaces Based Object Segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, pp. 394-398, 1997.
[6] E. Dijkstra, “A Note on Two Problems in Connexion with Graphs,” Numerische Mathematik, vol. 1, pp. 269-271, 1959.
[7] J.L.R. Ford and D.R. Fulkerson, Flows in Networks. Princeton, N.J.: Princeton Univ. Press, 1962.
[8] L.D. Cohen, “On Active Contour Models and Balloons,” Computer Vision, Graphics, and Image Processing. Image Understanding, vol. 53, no. 2, pp. 211-218, 1991,
[9] C. Xu and J.L. Prince, “Snakes, Shapes and Gradient Vector Flow,” IEEE Trans. Image Processing, vol. 7, no. 3, pp. 359-369, Mar. 1998.
[10] S. Lloyd, “Stereo Matching Using Intra- and Inter-Row Dynamic Programming,” Pattern Recognition Letters, vol. 4, pp. 273-277, Sept. 1986.
[11] Y. Ohta and T. Kanade, “Stereo by Intra- and Inter-Scanline Search Using Dynamic Programming,” IEEE Trans. Pattern Analysis Machine Intelligence, vol. 7, no. 2, pp. 139-154, Mar. 1985.
[12] C. Sun, “Fast Stereo Matching Using Rectangular Subregioning and 3D Maximum-Surface Techniques,” Int'l J. Computer Vision, vol. 47, nos. 1/2/3, pp. 99-117, May 2002.
[13] C. Leung, B. Appleton, and C. Sun, “Fast Stereo Matching by Iterated Dynamic Programming and Quadtree Subregioning,” Proc. British Machine Vision Conf., S.B.A. Hoppe and T. Ellis, eds., vol. 1, pp. 97-106, Sept. 2004.
[14] S. Roy and I.J. Cox, “A Maximum-Flow Formulation of the n-Camera Stereo Correspondence Problem,” Proc. Int'l Conf. Computer Vision, pp. 492-499, Jan. 1998.
[15] P. Bamford and B. Lovell, “Unsupervised Cell Nucleus Segmentation with Active Contours,” Signal Processing, special issue on deformable models and techniques for image and signal processing, vol. 71, no. 2, pp. 203-213, 1998.
[16] R. Sedgewick, Algorithms in C, third ed. Addison-Wesley, 2002.
[17] J.N. Tsitsiklis, “Efficient Algorithms for Globally Optimal Trajectories,” IEEE Trans. Automatic Control, vol. 40, no. 9, pp. 1528-1538, Sept. 1995.
[18] J. Sethian, “A Fast Marching Level Set Method for Monotonically Advancing Fronts,” Proc. Nat'l Academy of Sciences, vol. 93, no. 4, pp. 1591-1595, 1996,
[19] T.C. Hu, Integer Programming and Network Flows. Reading, Mass.: Addison-Wesley, 1969.
[20] Y. Boykov and V. Kolmogorov, “Computing Geodesics and Minimal Surfaces via Graph Cuts,” Proc. Int'l Conf. Computer Vision, pp. 26-33, Oct. 2003.
[21] R. Goldenberg, R. Kimmel, E. Rivlin, and M. Rudzsky, “Fast Geodesic Active Contours,” IEEE Trans. Image Processing, vol. 10, no. 10, pp. 1467-1475, 2001.
[22] L.D. Cohen and R. Kimmel, “Global Minimum for Active Contour Models: A Minimal Path Approach,” Intl J. Computer Vision, vol. 24, no. 1, pp. 57-78, Aug. 1997, html.
[23] B. Appleton and H. Talbot, “Globally Optimal Geodesic Active Contours,” J. Math. Imaging and Vision, July 2005.
[24] G. Strang, “Maximal Flow through a Domain,” Math. Programming, vol. 26, pp. 123-143, 1983.
[25] M. Iri, Survey of Mathematical Programming. North-Holland, Amsterdam, 1979.
[26] K. Weihe, “Maximum $(s, t){\hbox{-}}{\rm Flows}$ in Planar Networks in $O(|V|{\rm log}|V|)$ Time,” J. Computer and System Sciences, vol. 55, no. 3, pp. 454-475, Dec. 1997.
[27] J.S. Mitchell, “On Maximum Flows in Polyhedral Domains,” Proc. Fourth Ann. Symp. Computational Geometry, pp. 341-351, 1988.
[28] B. Appleton and H. Talbot, “Globally Optimal Surfaces by Continuous Maximal Flows,” Digital Image Computing: Techniques and Applications, Proc. VIIth APRS Conf., vol. 2, pp. 987-996, Dec. 2003.
[29] G. Strang, Introduction to Applied Mathematics. Wellesley-Cambridge Press, 1986.
[30] J. Siek, L.-Q. Lee, and A. Lumsdaine, The Boost Graph Library: User Guide and Reference Manual. Addison-Wesley, 2002.
[31] Y. Boykov and V. Kolmogorov, “An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 9, pp. 1124-1137, Sept. 2004.

Index Terms:
Index Terms- Partial differential equations, graph-theoretic methods, edge and feature detection.
Ben Appleton, Hugues Talbot, "Globally Minimal Surfaces by Continuous Maximal Flows," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 1, pp. 106-118, Jan. 2006, doi:10.1109/TPAMI.2006.12
Usage of this product signifies your acceptance of the Terms of Use.