| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Multiview Stereo via Volumetric Graph-Cuts and Occlusion Robust Photo-Consistency
December 2007 (vol. 29 no. 12)
pp. 2241-2246
This paper presents a volumetric formulation for the multi-view stereo problem which is amenable to a computationally tractable global optimisation using Graph-cuts. Our approach is to seek the optimal partitioning of 3D space into two regions labelled as ‘object’ and ‘empty’ under a cost functional consisting of the following two terms: (1) A term that forces the boundary between the two regions to pass through photo-consistent locations and (2) a ballooning term that inflates the ‘object’ region. To take account of the effect of occlusion on the first term we use an occlusion robust photo-consistency metric based on Normalised Cross Correlation, which does not assume any geometric knowledge about the reconstructed object. The globally optimal 3D partitioning can be obtained as the minimum cut solution of a weighted graph.
[1] 2241 A. Blake, C. Rother, M. Brown, P. Perez, and P. Torr, “Interactive Image Segmentation Using an Adaptive GMMRF Model,” Proc. European Conf. Computer Vision, pp. 428-441, 2004.[2] Y. Boykov and V. Kolmogorov, “Computing Geodesics and Minimal Surfaces via Graph Cuts,” Proc. Int'l Conf. Computer Vision, pp. 26-33, 2003.[3] Y. Boykov and V. Kolmogorov, “An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 9, pp. 1124-1137, Sept. 2004.[4] Y. Boykov and V. Lempitsky, “From Photohulls to Photoflux Optimization,” Proc. British Machine Vision Conf., pp. 1149-1158, 2006.[5] Y. Boykov, O. Veksler, and R. Zabih, “Fast Approximate Energy Minimization via Graph Cuts,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 11, pp. 1222-1239, Nov. 2001.[6] L.D. Cohen and I. Cohen, “Finite-Element Methods for Active Contour Models and Balloons for 2-D and 3-D Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 11, pp. 1131-1147, Nov. 1993.[7] O. Faugeras and R. Keriven, “Variational Principles, Surface Evolution, PDES, Level Set Methods and the Stereo Problem,” IEEE Trans. Image Processing, vol. 7, no. 3, pp. 335-344, 1998.[8] P. Fua and Y.G. Leclerc, “Object-Centred Surface Reconstruction: Combining Multi-Image Stereo and Shading,” Int'l J. Computer Vision, vol. 16, no. 1, pp. 35-56, 1995.[9] Y. Furukawa and J. Ponce, “Carved Visual Hulls for Image-Based Modeling,” Proc. European Conf. Computer Vision, vol. 1, pp. 564-577, 2006.[10] M. Goesele, B. Curless, and S.M. Seitz, “Multi-View Stereo Revisited,” Proc. Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 2402-2409, 2006.[11] C. Hernández and F. Schmitt, “Silhouette and Stereo Fusion for 3D Object Modeling,” Computer Vision and Image Understanding, vol. 96, no. 3, pp. 367-392, 2004.[12] C. Hernández, F. Schmitt, and R. Cipolla, “Silhouette Coherence for Camera Calibration under Circular Motion,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 2, pp. 343-349, Feb. 2007.[13] A. Hornung and L. Kobbelt, “Hierarchical Volumetric Multi-View Stereo Reconstruction of Manifold Surfaces Based on Dual Graph Embedding,” Proc. Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 503-510, 2006.[14] V. Kolmogorov and R. Zabih, “Multi-Camera Scene Reconstruction via Graph-Cuts,” Proc. European Conf. Computer Vision, vol. 3, pp. 82-96, 2002.[15] V. Kolmogorov and R. Zabih, “What Energy Functions Can Be Minimized via Graph Cuts,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 2, pp. 147-159, Feb. 2004.[16] K.N. Kutulakos and S.M. Seitz, “A Theory of Shape by Space Carving,” Int'l J. Computer Vision, vol. 38, no. 3, pp. 199-218, 2000.[17] V. Lempitsky, Y. Boykov, and D. Ivanov, “Oriented Visibility for Multiview Reconstruction,” Proc. European Conf. Computer Vision, vol. 3, pp. 226-238, 2006.[18] S. Osher and J. Sethian, “Fronts Propagating with Curvature-Dependent Speed: Algorithms Based on Hamilton-Jacobi Equations,” J. Computer Physics, vol. 79, pp. 12-49, 1988.[19] E. Parzen, “On Estimation of a Probability Density Function and Mode,” Ann. Math. Statistics, vol. 33, pp. 1065-1076, 1962.[20] J.-P. Pons, R. Keriven, and O. Faugeras, “Multi-View Stereo Reconstruction and Scene Flow Estimation with a Global Image-Based Matching Score,” Int'l J. Computer Vision, vol. 72, no. 2, pp. 179-193, 2007.[21] S. Roy and I.J. Cox, “A Maximum-Flow Formulation of the N-Camera Stereo Correspondence Problem,” Proc. Int'l Conf. Computer Vision, pp. 735-743, 1998.[22] D. Scharstein and R. Szeliski, “A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms,” Int'l J. Computer Vision, vol. 47, nos. 1-3, pp. 7-42, 2002.[23] S.M. Seitz, B. Curless, J. Diebel, D. Scharstein, and R. Szeliski, “A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms,” Proc. Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 519-528, 2006.[24] S. Sinha and M. Pollefeys, “Multi-View Reconstruction Using Photo-Consistency and Exact Silhouette Constraints: A Maximum-Flow Formulation,” Proc. Int'l Conf. Computer Vision, vol. 1, pp. 349-356, 2005.[25] J. Starck, A. Hilton, and G. Miller, “Volumetric Stereo with Silhouette and Feature Constraints,” Proc. British Machine Vision Conf., vol. 3, pp. 1189-1198, 2006.[26] C. Strecha, R. Tuytelaars, and L. Van Gool, “Dense Matching of Multiple Wide-Baseline Views,” Proc. Int'l Conf. Computer Vision, pp. 1194-1201, 2003.[27] J. Sun, H.-Y. Shum, and N.-N. Zheng, “Stereo Matching Using Belief Propagation,” Proc. European Conf. Computer Vision, pp. 510-524, 2002.[28] S. Tran and L. Davis, “3D Surface Reconstruction Using Graph Cuts with Surface Constraints,” Proc. European Conf. Computer Vision, vol. 2, pp. 218-231, 2006.[29] G. Vogiatzis, P.H.S. Torr, and R. Cipolla, “Multi-View Stereo via Volumetric Graph-Cuts,” Proc. Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 391-398, 2005.
Citation:
George Vogiatzis, Carlos Hernández Esteban, Philip H. S. Torr, Roberto Cipolla, "Multiview Stereo via Volumetric Graph-Cuts and Occlusion Robust Photo-Consistency," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, no. 12, pp. 2241-2246, June 2007, doi:10.1109/TPAMI.2007.70712
