This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Differential Geometric Inference in Surface Stereo
January 2010 (vol. 32 no. 1)
pp. 72-86
ASCII Text
x 
 
Gang Li, Steven W. Zucker, "Differential Geometric Inference in Surface Stereo," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, no. 1, pp. 72-86, January, 2010.
 
 
BibTex
x
 
@article{ 10.1109/TPAMI.2008.270,
author = {Gang Li and Steven W. Zucker},
title = {Differential Geometric Inference in Surface Stereo},
journal ={IEEE Transactions on Pattern Analysis and Machine Intelligence},
volume = {32},
number = {1},
issn = {0162-8828},
year = {2010},
pages = {72-86},
doi = {http://doi.ieeecomputersociety.org/10.1109/TPAMI.2008.270},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - JOUR
JO - IEEE Transactions on Pattern Analysis and Machine Intelligence
TI - Differential Geometric Inference in Surface Stereo
IS - 1
SN - 0162-8828
SP72
EP86
EPD - 72-86
A1 - Gang Li,
A1 - Steven W. Zucker,
PY - 2010
KW - Stereo matching
KW - surface stereo
KW - differential geometry
KW - curved surface
KW - slanted surface
KW - computational inference
KW - half-occluded surface region.
VL - 32
JA - IEEE Transactions on Pattern Analysis and Machine Intelligence
ER -
 
Gang Li, Siemens Corporate Research, Princeton
Steven W. Zucker, Yale University, New Haven
Many traditional two-view stereo algorithms explicitly or implicitly use the frontal parallel plane assumption when exploiting contextual information since, e.g., the smoothness prior biases toward constant disparity (depth) over a neighborhood. This introduces systematic errors to the matching process for slanted or curved surfaces. These errors are nonnegligible for detailed geometric modeling of natural objects such as a human face. We show how to use contextual information geometrically to avoid such errors. A differential geometric study of smooth surfaces allows contextual information to be encoded in Cartan's moving frame model over local quadratic approximations, providing a framework of geometric consistency for both depth and surface normals; the accuracy of our reconstructions argues for the sufficiency of the approximation. In effect, Cartan's model provides the additional constraint necessary to move beyond the frontal parallel plane assumption in stereo reconstruction. It also suggests how geometry can extend surfaces to account for unmatched points due to partial occlusion.

[1] S.T. Barnard and M.A. Fischler, “Computational Stereo,” ACM Computing Surveys, vol. 14, no. 4, pp. 553-572, 1982.
[2] P.N. Belhumeur, “A Bayesian Approach to Binocular Stereopsis,” Int'l J. Computer Vision, vol. 19, no. 3, pp. 237-262, 1996.
[3] O. Ben-Shahar and S.W. Zucker, “The Perceptual Organization of Texture Flow: A Contextual Inference Approach,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 4, pp. 401-417, Apr. 2003.
[4] S. Birchfield and C. Tomasi, “A Pixel Dissimilarity Measure that is Insensitive to Image Sampling,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 4, pp. 401-406, Apr. 1998.
[5] S. Birchfield and C. Tomasi, “Multiway Cut for Stereo and Motion with Slanted Surfaces,” Proc. IEEE Int'l Conf. Computer Vision, 1999.
[6] A. Blake and A. Zisserman, Visual Reconstruction. The MIT Press, 1987.
[7] Y. Boykov, O. Veksler, and R. Zabih, “Fast Approximate Energy Minimization via Graph Cuts,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 11, pp. 1222-1239, Nov. 2001.
[8] M.Z. Brown, D. Burschka, and G.D. Hager, “Advances in Computational Stereo,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 8, pp. 993-1008, Aug. 2003.
[9] R. Cipolla and P. Giblin, Visual Motion of Curves and Surfaces. Cambridge Univ. Press, 2000.
[10] F. Devernay and O.D. Faugeras, “Computing Differential Properties of 3-D Shapes from Stereoscopic Images without 3-D Models,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1994.
[11] U.R. Dhond and J.K. Aggarwal, “Structure from Stereo—A Review,” IEEE Trans. Systems, Man, and Cybernetics, vol. 19, no. 6, pp. 1489-1510, Nov./Dec. 1989.
[12] M.P. do Carmo, Differential Geometry of Curves and Surfaces. Prentice-Hall, Inc., 1976.
[13] G. Egnal and R.P. Wildes, “Detecting Binocular Half-Occlusions: Empirical Comparisons of Five Approaches,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 8, pp. 1127-1133, Aug. 2002.
[14] O. Faugeras, Three-Dimensional Computer Vision. The MIT Press, 1993.
[15] O. Faugeras and R. Keriven, “Variational Principles, Surface Evolution, PDE's, Level Set Methods, and the Stereo Problem,” IEEE Trans. Image Processing, vol. 7, no. 3, pp. 336-344, Mar. 1998.
[16] P.F. Felzenszwalb and D.P. Huttenlocher, “Efficient Belief Propagation for Early Vision,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004.
[17] W.T. Freeman, E.C. Pasztor, and O.T. Carmichael, “Learning Low-Level Vision,” Int'l J. Computer Vision, vol. 40, no. 1, pp. 25-47, 2000.
[18] T. Frohlinghaus and J.M. Buhmann, “Regularizing Phase-Based Stereo,” Proc. Int'l Conf. Pattern Recognition, 1996.
[19] B. Goldlucke, I. Ihrke, C. Linz, and M. Magnor, “Weighted Minimal Hypersurface Reconstruction,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 7, pp. 1194-1208, July 2007.
[20] R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge Univ. Press, 2000.
[21] H. Hirschmuller and D. Scharstein, “Evaluation of Cost Functions for Stereo Matching,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[22] W. Hoff and N. Ahuja, “Surfaces from Stereo: Integrating Feature Matching, Disparity Estimation, and Contour Detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 2, pp.121-136, Feb. 1989.
[23] R.A. Hummel and S.W. Zucker, “On the Foundations of Relaxation Labeling Processes,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 5, no. 3, pp. 267-287, May 1983.
[24] H. Jin, S. Soatto, and A.J. Yezzi, “Multi-View Stereo Reconstruction of Dense Shape and Complex Appearance,” Int'l J. Computer Vision, vol. 63, no. 3, pp. 175-189, 2005.
[25] T. Kanade and M. Okutomi, “A Stereo Maching Algorithm with an Adaptive Window: Theory and Experiment,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 9, pp. 920-932, Sept. 1994.
[26] M. Kass, A. Witkin, and D. Terzopoulos, “Snakes: Active Contour Models,” Int'l J. Computer Vision, vol. 1, pp. 321-331, 1988.
[27] R. Kimmel, “3D Shape Reconstruction from Autostereograms and Stereo,” J. Visual Comm. and Image Representation, pp. 324-333, 2002.
[28] N. Komodakis and G. Tziritas, “Image Completion Using Efficient Belief Propagation via Priority Scheduling and Dynamic Pruning,” IEEE Trans. Image Processing, vol. 16, no. 11, pp. 2649-2661, Nov. 2007.
[29] R. Lengagne, O. Monga, and P. Fua, “Using Differential Constraints to Reconstruct Complex Surfaces from Stereo,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1997.
[30] G. Li and S.W. Zucker, “Contextual Inference in Contour-Based Stereo Correspondence,” Int'l J. Computer Vision, vol. 69, no. 1, pp.59-75, 2006.
[31] G. Li and S.W. Zucker, “Differential Geometric Consistency Extends Stereo to Curved Surfaces,” Proc. European Conf. Computer Vision, 2006.
[32] G. Li and S.W. Zucker, “Surface Geometric Constraints for Stereo in Belief Propagation,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
[33] S.Z. Li, Markov Random Field Modeling in Image Analysis. Springer-Verlag, 2001.
[34] M.H. Lin and C. Tomasi, “Surfaces with Occlusions from Layered Stereo,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 8, pp. 1073-1078, Aug. 2004.
[35] D. Marr and T. Poggio, “Cooperative Computation of Stereo Disparity,” Science, vol. 194, pp. 283-287, 1976.
[36] K. Nakayama and S. Shimojo, “Da Vinci Stereopsis: Depth and Subjective Occluding Contours from Unpaired Image Points,” Vision Research, vol. 30, no. 11, pp. 1811-1825, 1990.
[37] A.S. Ogale and Y. Aloimonos, “Stereo Correspondence with Slanted Surfaces: Critical Implications of Horizontal Slant,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004.
[38] B. O'Neill, Elementary Differential Geometry, second ed. Academic Press, 1997.
[39] G.A. Orban, P. Janssen, and R. Vogels, “Extracting 3D Structure from Disparity,” Trends in Neurosciences, vol. 29, no. 8, pp. 466-473, 2006.
[40] P. Parent and S.W. Zucker, “Trace Inference, Curvature Consistency, and Curve Detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 8, pp. 823-839, Aug. 1989.
[41] W.H. Press, S.A. Teukolsky, W.T. Vetterling, and B.P. Flannery, Numerical Recipes in C, second ed. Cambridge Univ. Press, 1992.
[42] P.T. Sander and S.W. Zucker, “Inferring Surface Trace and Differential Structure from 3-D Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 9, pp. 833-854, Sept. 1990.
[43] D. Scharstein and R. Szeliski, “Stereo Matching with Nonlinear Diffusion,” Int'l J. Computer Vision, vol. 28, no. 2, pp. 155-174, 1998.
[44] D. Scharstein and R. Szeliski, “A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms,” Int'l J. Computer Vision, vol. 47, nos. 1-3, pp. 7-42, 2002.
[45] D. Scharstein and R. Szeliski, “High-Accuracy Stereo Depth Maps Using Structured Light,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.
[46] C. Strecha, T. Tuytelaars, and L.V. Gool, “Dense Matching of Multiple Wide Baseline Views,” Proc. IEEE Int'l Conf. Computer Vision, 2003.
[47] J. Sun, N.-N. Zheng, and H.-Y. Shum, “Stereo Matching Using Belief Propagation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 7, pp. 787-800, July 2003.
[48] H. Tao, H.S. Sawhney, and R. Kumar, “A Global Matching Framework for Stereo Computation,” Proc. IEEE Int'l Conf. Computer Vision, 2001.
[49] M.F. Tappen and W.T. Freeman, “Comparison of Graph Cuts with Belief Propagation for Stereo, Using Identical MRF Parameters,” Proc. IEEE Int'l Conf. Computer Vision, 2003.
[50] Y. Tsin and T. Kanade, “A Correlation-Based Model Prior for Stereo,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004.
[51] O.J. Woodford, P.H.S. Torr, I.D. Reid, and A.W. Fitzgibbon, “Global Stereo Reconstruction under Second Order Smoothness Priors,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[52] L. Zhang and S.M. Seitz, “Estimating Optimal Parameters for MRF Stereo from a Single Image Pair,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 2, pp. 331-342, Feb. 2007.
[53] C.L. Zitnick and T. Kanade, “A Cooperative Algorithm for Stereo Mathching and Occlusion Detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 7, pp. 675-684, July 2000.
[54] S.W. Zucker, “Differential Geometry from the Frenet Point of View: Boundary Detection, Stereo, Texture and Color,” Handbook of Mathematical Models in Computer Vision, N. Paragios, Y. Chen, and O. Faugeras, eds., Springer, 2005.

Index Terms:
Stereo matching, surface stereo, differential geometry, curved surface, slanted surface, computational inference, half-occluded surface region.
Citation:
Gang Li, Steven W. Zucker, "Differential Geometric Inference in Surface Stereo," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, no. 1, pp. 72-86, Jan. 2010, doi:10.1109/TPAMI.2008.270
Usage of this product signifies your acceptance of the Terms of Use.