The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.01 - January (2010 vol.32)
pp: 135-147
Florent Lafarge , Ariana Research Group, INRIA and Matis Laboratory, French Mapping Agency, Sophia Antipolis
Xavier Descombes , Ariana Research Group, INRIA, Sophia Antipolis
Josiane Zerubia , Ariana Research Group, INRIA, Sophia Antipolis
Marc Pierrot-Deseilligny , French Mapping Agency (IGN), Saint-Mandé
ABSTRACT
We present a new approach for building reconstruction from a single Digital Surface Model (DSM). It treats buildings as an assemblage of simple urban structures extracted from a library of 3D parametric blocks (like a LEGO set). First, the 2D-supports of the urban structures are extracted either interactively or automatically. Then, 3D-blocks are placed on the 2D-supports using a Gibbs model which controls both the block assemblage and the fitting to data. A Bayesian decision finds the optimal configuration of 3D--blocks using a Markov Chain Monte Carlo sampler associated with original proposition kernels. This method has been validated on multiple data set in a wide-resolution interval such as 0.7 m satellite and 0.1 m aerial DSMs, and provides 3D representations on complex buildings and dense urban areas with various levels of detail.
INDEX TERMS
3D reconstruction, urban area, digital surface model, stochastic models, Monte Carlo simulations.
CITATION
Florent Lafarge, Xavier Descombes, Josiane Zerubia, Marc Pierrot-Deseilligny, "Structural Approach for Building Reconstruction from a Single DSM", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.32, no. 1, pp. 135-147, January 2010, doi:10.1109/TPAMI.2008.281
REFERENCES
[1] H. Mayer, “Automatic Object Extraction from Aerial Imagery—A Survey Focusing on Buildings,” Computer Vision and Image Understanding, vol. 74, no. 2, pp. 138-149, 1999.
[2] E.P. Baltsavias, “Object Extraction and Revision by Image Analysis Using Existing Geodata and Knowledge: Current Status and Steps towards Operational Systems,” ISPRS J. Photogrammetry and Remote Sensing, vol. 58, nos. 3-4, 2004.
[3] S. Scholze, T. Moons, and L. Van Gool, “A Probabilistic Approach to Building Roof Reconstruction Using Semantic Labelling,” Proc. 24th DAGM Symp. Pattern Recognition, 2002.
[4] Z. Kim and R. Nevatia, “Automatic Description of Complex Buildings from Multiple Images,” Computer Vision and Image Understanding, vol. 96, no. 1, pp. 60-95, 2004.
[5] C. Baillard, C. Schmid, A. Zisserman, and A. Fitzgibbon, “Automatic Line Matching and 3D Reconstruction of Buildings from Multiple Views,” Proc. ISPRS Conf. Automatic Extraction of GIS Objects from Digital Imagery, 1999.
[6] F. Taillandier and R. Deriche, “Automatic Buildings Reconstruction from Aerial Images: A Generic Bayesian Framework,” Proc. ISPRS Congress, 2004.
[7] U. Weidner and W. Förstner, “Towards Automatic Building Reconstruction from High Resolution Digital Elevation Models,” ISPRS J. Photogrammetry and Remote Sensing, vol. 50, no. 4, pp. 38-49, 1995.
[8] R. Collins, C. Jaynes, Y. Cheng, X. Wang, F. Stolle, E. Riseman, and A.R. Hanson, “The Ascender System: Automated Site Modeling from Multiple Aerial Images,” Computer Vision and Image Understanding, vol. 72, no. 2, pp. 143-162, 1998.
[9] M. Brédif, D. Boldo, M. Pierrot-Deseilligny, and H. Maître, “3D Building Reconstruction with Parametric Roof Superstructures,” Proc. IEEE Int'l Conf. Image Processing, 2007.
[10] A. Fischer, T. Kolbe, F. Lang, A. Cremers, W. Förstner, L. Plümer, and V. Steinhage, “Extracting Buildings from Aerial Images Using Hierarchical Aggregation in 2D and 3D,” Computer Vision and Image Understanding, vol. 72, no. 2, pp. 185-203, 1998.
[11] E. Gülch and H. Müller, “New Applications of Semi-Automatic Building Extraction,” Proc. Third Int'l Workshop Automatic Extraction of Man-Made Objects from Aerial and Space Images, 2001.
[12] S.C. Lee and R. Nevatia, “Interactive 3D Building Modeling Using a Hierarchical Representation,” Proc. IEEE Workshop Higher-Level Knowledge in 3D Modeling and Motion, 2003.
[13] H.G. Maas and G. Vosselman, “Two Algorithms for Extracting Building Models from Raw Laser Altimetry Data,” ISPRS J. Photogrammetry and Remote Sensing, vol. 54, nos. 2-3, pp. 153-163, 1999.
[14] C. Brenner, “Building Reconstruction from Images and Laser Scanning,” Int'l J. Applied Earth Observation and Geoinformation, vol. 5, pp. 187-198, 2005.
[15] C. Früh, S. Jain, and A. Zakhor, “Data Processing Algorithms for Generating Textured 3D Building Facade Meshes from Laser Scans and Camera Images,” Int'l J. Computer Vision, vol. 61, no. 2, pp. 159-184, 2005.
[16] P. Müller, P. Wonka, S. Haegler, A. Ulmer, and L. Van Gool, “Procedural Modeling of Buildings,” Proc. ACM SIGGRAPH, 2006.
[17] F. Lafarge, X. Descombes, J. Zerubia, and M. Pierrot-Deseilligny, “An Automatic Building Reconstruction Method: A Structural Approach Using High Resolution Images,” Proc. IEEE Int'l Conf. Image Processing, 2006.
[18] F. Lafarge, X. Descombes, J. Zerubia, and M. Pierrot-Deseilligny, “Building Reconstruction from a Single DEM,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[19] N. Haala and C. Brenner, “Extraction of Buildings and Trees in Urban Environments,” ISPRS J. Photogrammetry and Remote Sensing, vol. 54, nos. 2-3, pp. 130-137, 1999.
[20] C. Vestri and F. Devernay, “Using Robust Methods for Automatic Extraction of Buildings,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001.
[21] T. Bailloeul, V. Prinet, B. Serra, and P. Marthon, “Spatio-Temporal Prior Shape Constraint for Level Set Segmentation,” Energy Minimization Methods in Computer Vision and Pattern Recognition, Springer, 2005.
[22] M. Ortner, X. Descombes, and J. Zerubia, “Building Outline Extraction from Digital Elevation Models Using Marked Point Processes,” Int'l J. Computer Vision, vol. 72, no. 2, pp. 107-132, 2007.
[23] F. Lafarge, X. Descombes, J. Zerubia, and M. Pierrot-Deseilligny, “Automatic Building Extraction from DEMs Using an Object Approach and Application to the 3D-City Modeling,” ISPRS J. Photogrammetry and Remote Sensing, vol. 63, no. 3, pp. 365-381, 2008.
[24] M. Metropolis, A.W. Rosenbluth, A.H. Teller, and E. Teller, “Equation of State Calculations by Fast Computing Machines,” J.Chemical Physics, vol. 21, p. 1087, 1953.
[25] G. Xu and Z. Zhang, Epipolar Geometry in Stereo, Motion and Object Recognition. Kluwer Academic, 1996.
[26] F. Lafarge, “Stochastic Approaches for 3D Building Reconstruction,” PhD dissertation, Ecole Nat'l Supérieure des Mines de Paris, 2007.
[27] P.J. Green, “Reversible Jump Markov Chains Monte Carlo Computation and Bayesian Model Determination,” Biometrika, vol. 82, pp. 711-732, 1995.
[28] W.K. Hastings, “Monte Carlo Sampling Using Markov Chains and Their Applications,” Biometrika, vol. 57, no. 1, pp. 97-109, 1970.
[29] A.R. Dick, P.H.S. Torr, and R. Cipolla, “Modelling and Interpretation of Architecture from Several Images,” Int'l J. Computer Vision, vol. 60, no. 2, pp. 111-134, 2004.
[30] C. Brenner and N. Ripperda, “Extraction of Facades Using RJMCMC and Constraint Equations,” Proc. ISPRS Commission III Symp. Photogrammetric and Computer Vision, 2006.
[31] Z.W. Tu and S.C. Zhu, “Image Segmentation by Data-Driven Markov Chain Monte Carlo,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 657-673, May 2002.
[32] P.J.M. Van Laarhoven and E.H.L. Aarts, Simulated Annealing: Theory and Applications. Springer, 1987.
[33] G. Perrin, X. Descombes, and J. Zerubia, “Adaptive Simulated Annealing for Energy Minimization Problem in a Marked Point Process Application,” Energy Minimization Methods in Computer Vision and Pattern Recognition, Springer, 2005.
[34] J.M. Varanelli, “On the Acceleration of the Simulated Annealing,” PhD dissertation, Univ. of Virginia, 1996.
[35] H. Haario and E. Saksman, “Simulated Annealing Process in General State Space,” Advances in Applied Probability, vol. 23, no. 4, pp. 866-893, 1991.
[36] S.R. White, “Concepts of Scale in Simulated Annealing,” Proc. IEEE Int'l Conf. Computer Design, 1984.
[37] M. Pierrot-Deseilligny and N. Paparoditis, “A Multiresolution and Optimization-Based Image Matching Approach: An Application to Surface Reconstruction from SPOT5-HRS Stereo Imagery,” Int'l Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 36, no. 1 (w41), 2006.
[38] S. Roy and I.J. Cox, “A Maximum-Flow Formulation of the N-Camera Stereo Correspondence Problem,” Proc. IEEE Int'l Conf. Computer Vision, 1998.
[39] U. Grenander and M.I. Miller, “Representations of Knowledge in Complex Systems,” J. Royal Statistical Soc., vol. 56, no. 4, pp. 549-603, 1994.
[40] F. Han, Z.W. Tu, and S.C. Zhu, “Range Image Segmentation by an Effective Jump-Diffusion Method,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 9, pp. 1138-1153, Sept. 2004.
[41] H. Hirschmüller, “Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
15 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool