This Article 
 Bibliographic References 
 Add to: 
Inference of Surfaces, 3D Curves, and Junctions from Sparse, Noisy, 3D Data
November 1997 (vol. 19 no. 11)
pp. 1265-1277

Abstract—We address the problem of obtaining dense surface information from a sparse set of 3D data in the presence of spurious noise samples. The input can be in the form of points, or points with an associated tangent or normal, allowing both position and direction to be corrupted by noise. Most approaches treat the problem as an interpolation problem, which is solved by fitting a surface such as a membrane or thin plate to minimize some function. We argue that these physical constraints are not sufficient, and propose to impose additional perceptual constraints such as good continuity and "cosurfacity." These constraints allow us to not only infer surfaces, but also to detect surface orientation discontinuities, as well as junctions, all at the same time. The approach imposes no restriction on genus, number of discontinuities, number of objects, and is noniterative. The result is in the form of three dense saliency maps for surfaces, intersections between surfaces (i.e., 3D curves), and 3D junctions, respectively. These saliency maps are then used to guide a "marching" process to generate a description (e.g., a triangulated mesh) making information about surfaces, space curves, and 3D junctions explicit. The traditional marching process needs to be refined as the polarity of the surface orientation is not necessarily locally consistent. These three maps are currently not integrated, and this is the topic of our ongoing research. We present results on a variety of computer-generated and real data, having varying curvature, of different genus, and multiple objects.

[1] N. Ahuja and M. Tuceryan, "Extraction of Early Perceptual Structure in Dot Patterns: Integrating Region, Boundary, and Component Gestalt," Computer Vision, Graphics, and Image Processing, vol. 48, pp. 304-356, 1989.
[2] J.D. Boissonnat, "Representation of Objects by Triangulating Points in 3-D Space," Proc. Sixth Int'l Conf. Pattern Recognition, pp. 830-832, 1982.
[3] T.E. Boult and J.R. Kender, "Visual Surface Reconstruction Using Sparse Depth Data," Proc. Computer Vision and Pattern Recognition, pp. 68-76,Miami Beach, Fla., 1986.
[4] A. Blake and A. Zisserman, "Invariant Surface Reconstruction Using Weak Continuity Constraints," Proc. Computer Vision and Pattern Recognition, pp. 62-67,Miami Beach, Fla., 1986.
[5] J. Dolan and R. Weiss, "Perceptual Grouping of Curved Lines," Proc. Image Understanding Workshop, pp. 1,135-1,145,Palo Alto, Calif., 1989.
[6] P. Fua and P. Sander, "Segmenting Unstructured 3D Points Into Surfaces," Proc. European Conf. Computer Vision, pp. 676-680,Santa Margherita Ligure, Italy, 1992.
[7] H. Hoppe, T. DeRose, T. Duchamp, J. McDonald, and W. Stuetzle, "Surface Reconstruction From Unorganized Points," Computer Graphics, vol. 26, pp. 71-78, 1992.
[8] W.E. Lorensen and H.E. Cline, "Marching Cubes: A High Resolution 3D Surface Reconstruction Algorithm," Computer Graphics, vol. 21, no. 4, 1987.
[9] G. Guy and G. Medioni, "Perceptual Grouping Using Global Saliency-Enhancing Operators," Proc. Int'l Conf. Pattern Recognition '92, vol. 1, pp. 99-103, 1992.
[10] G. Guy and G. Medioni, "Inference of Multiple Curves and Surfaces From Sparse Data," IRIS-USC technical report, PhD Thesis, Univ. of Southern California.
[11] G. Guy and G. Medioni, "Inferring Global Perceptual Contours From Local Features," Int'l J. Computer Vision, vol. 20, no. 1/2, pp. 113-133, 1996.
[12] S. Han and G. Medioni, "Triangular NURBS Surface Modeling of Scattered Data," Proc. IEEE Visualization '96, pp. 295-302, 1996.
[13] M. Kass, A. Witkin, and D. Terzopoulos, "Snakes: Active Contour Models," Int'l J. Computer Vision, pp. 321-331, 1988.
[14] C. Liao and G. Medioni, "Surface Approximation of a Cloud of 3-D Points," CAD94 Workshop,Pittsburgh, Pa., 1994.
[15] D.G. Lowe, "Three-Dimensional Object Recognition From Single Two-Dimensional Images," Artificial Intelligence, vol. 31, pp. 355-395, 1987.
[16] R. Mohan and R. Nevatia,“Segmentation and description based on perceptual organization,” Proc. of Computer Vision and Pattern Recognition Conf., pp. 333-341,San Diego, Calif., 1989.
[17] R. Mohan and R. Nevatia, “Using Perceptual Organization to Extract 3-D Structures,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 11, pp. 1,121-1,139, Nov. 1989.
[18] T. Poggio and F. Girosi, "A Theory of Networks for Learning," Science, vol. 247, pp. 978-982, 1990.
[19] R. Szeliski, D. Tonnesen, and D. Terzopoulos, "Modeling Surfaces of Arbitrary Topology with Dynamic Particles," Proc. IEEE Computer Vision and Pattern Recognition, pp. 82-85,New York, NY, June 1993.
[20] S.S. Sinha and B.G. Schunck, "Surface Approximation Using Weighted Splines," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 44-49,Lahaina, Hawaii., June 1991.
[21] D. Terzopoulos, "Regularization of Inverse Visual Problems Involving Discontinuities," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 4, pp. 413-424, 1986.
[22] D. Terzopoulos, "Image Analysis Using Multigrid Relaxation Methods," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 2, pp. 129-139, 1986.
[23] D. Terzopoulos, A. Witkin, and M. Kass, "Constraints on Deformable Models: Recovering 3D Shape and Nonrigid Motion," Artificial Intelligence, vol. 36, pp. 91-123, 1988.
[24] N. Vaidya and K. Boyer, "Discontinuity Preserving Surface Reconstruction Through Global Optimization," Proc. Int'l Symp. Computer Vision, pp. 115-120, 1995.

Index Terms:
Segmentation and feature extraction, human visual perception issues, isosurface extraction.
Gideon Guy, Gérard Medioni, "Inference of Surfaces, 3D Curves, and Junctions from Sparse, Noisy, 3D Data," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 11, pp. 1265-1277, Nov. 1997, doi:10.1109/34.632985
Usage of this product signifies your acceptance of the Terms of Use.