The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.10 - Oct. (2013 vol.19)
pp: 1720-1731
Tian Fang , Dept. of Comput. Sci. & Eng., Hong Kong Univ. of Sci. & Technol., Kowloon, China
Zhexi Wang , Dept. of Comput. Sci. & Eng., Hong Kong Univ. of Sci. & Technol., Kowloon, China
Honghui Zhang , Dept. of Comput. Sci. & Eng., Hong Kong Univ. of Sci. & Technol., Kowloon, China
Long Quan , Dept. of Comput. Sci. & Eng., Hong Kong Univ. of Sci. & Technol., Kowloon, China
ABSTRACT
In this paper, we propose an unwrappable representation for image-based façade modeling from multiple registered images. An unwrappable façade is represented by the mutually orthogonal baseline and profile. We first reconstruct semidense 3D points from images, then the baseline and profile are extracted from the point cloud to construct the base shape and compose the textures of the building from the images. Through our unwrapping process, the reconstructed 3D points and composed textures are further mapped to an unwrapped space that is parameterized by the baseline and profile. In doing so, the unwrapped space becomes equivalent to the planar space in which planar façade modeling techniques can be used to reconstruct the details of the buildings. Finally, the augmented details can be wrapped back to the original 3D space to generate the final model. This newly introduced unwrappable representation extends the state-of-the-art modeling for planar façades to a more general class of façades. We demonstrate the power of the unwrappable representation with a few examples in which the façade is not planar.
INDEX TERMS
Image reconstruction, Three-dimensional displays, Solid modeling, Optimization, Computational modeling, Shape, Buildings,reconstruction, Modeling packages
CITATION
Tian Fang, Zhexi Wang, Honghui Zhang, Long Quan, "Image-Based Modeling of Unwrappable Façades", IEEE Transactions on Visualization & Computer Graphics, vol.19, no. 10, pp. 1720-1731, Oct. 2013, doi:10.1109/TVCG.2013.68
REFERENCES
[1] P.E. Debevec, C.J. Taylor, and J. Malik, "Modeling and Rendering Architecture from Photographs: A Hybrid Geometry- and Image-Based Approach," Proc. ACM SIGGRAPH '96, pp. 11-20, 1996.
[2] P. Müller, G. Zeng, P. Wonka, and L.V. Gool, "Image-Based Procedural Modeling of Facades," ACM Trans. Graphics, vol. 26, pp. 85:1-85:10, July 2007.
[3] J. Xiao, T. Fang, P. Tan, P. Zhao, E. Ofek, and L. Quan, "Image-Based Facade Modeling," ACM Trans. Graphics, vol. 27, no. 5, pp. 161:1-161:10, Dec. 2008.
[4] S.N. Sinha, D. Steedly, R. Szeliski, M. Agrawala, and M. Pollefeys, "Interactive 3D Architectural Modeling from Unordered Photo Collections," ACM Trans. Graphics, vol. 27, no. 5, pp. 159:1-159:10, Dec. 2008.
[5] J. Xiao, T. Fang, P. Zhao, M. Lhuillier, and L. Quan, "Image-Based Street-Side City Modeling," ACM Trans. Graphics, vol. 28, no. 5, pp. 114:1-114:12, Dec. 2009.
[6] N. Jiang, P. Tan, and L.-F. Cheong, "Symmetric Architecture Modeling with a Single Image," ACM Trans. Graphics, vol. 28, pp. 113:1-113:8, Dec. 2009.
[7] Y. Furukawa, B. Curless, S.M. Seitz, and R. Szeliski, "Manhattan-World Stereo," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[8] D. Gallup, J.-M. Frahm, M. Pollefeys, and C. Hill, "Piecewise Planar and Non-Planar Stereo for Urban Scene Reconstruction," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[9] S.M. Seitz, B. Curless, J. Diebel, D. Scharstein, and R. Szeliski, "A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
[10] H.-H. Vu, P. Labatut, J.-P. Pons, and R. Keriven, "High Accuracy and Visibility-Consistent Dense Multiview Stereo," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 5, pp. 889-901, May 2012.
[11] Y. Furukawa, B. Curless, S. Seitz, and R. Szeliski, "Towards Internet-Scale Multi-View Stereo," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[12] Y. Furukawa and J. Ponce, "Accurate, Dense, and Robust Multi-View Stereopsis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 8, pp. 1362-1376, Aug. 2010.
[13] P. Labatut, J.-P. Pons, and R. Keriven, "Hierarchical Shape-Based Surface Reconstruction for Dense Multi-View Stereo," Proc. IEEE 12th Int'l Conf. Computer Vision Workshops (ICCV), pp. 1598-1605, Sept. 2009.
[14] M. Pollefeys, D. Nistér, J.-M. Frahm, A. Akbarzadeh, P. Mordohai, B. Clipp, C. Engels, D. Gallup, S. Kim, P. Merrell, C. Salmi, S. Sinha, B. Talton, L. Wang, Q. Yang, H. Stewénius, R. Yang, G. Welch, and H. Towles, "Detailed Real-Time Urban 3D Reconstruction from Video," Int'l J. Computer Vision, vol. 78, no. 2, pp. 143-167, 2008.
[15] S. Agarwal, N. Snavely, I. Simon, S. Seitz, and R. Szeliski, "Building Rome in a Day," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 72-79, 2009.
[16] J.-M. Frahm, P. Fite-Georgel, D. Gallup, T. Johnson, R. Raguram, C. Wu, Y.-H. Jen, E. Dunn, B. Clipp, S. Lazebnik, and M. Pollefeys, "Building Rome on a Cloudless Day," Proc. European Conf. Computer Vision, 2010.
[17] "Photomodeler: A Commercial Photogrammetry Product," EOS SYSTEMS, http:/www.photomodeler.com, 2013.
[18] A. van den Hengel, A. Dick, T. Thormählen, B. Ward, and P.H.S. Torr, "Videotrace: Rapid Interactive Scene Modelling from Video," ACM Trans. Graphics, vol. 26, no. 3, pp. 86-90, Aug. 2007.
[19] H. Riemenschneider, U. Krispel, W. Thaller, M. Donoser, S. Havemann, D. Fellner, and H. Bischof, "Irregular Lattices for Complex Shape Grammar Facade Parsing," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2012.
[20] L. Spinello, R. Triebel, D. Vasquez, K. Arras, and R. Siegwart, "Exploiting Repetitive Object Patterns for Model Compression and Completion," Proc. European Conf. Computer Vision, 2010.
[21] T. Thormählen and H.-P. Seidel, "3D-Modeling by Ortho-Image Generation from Image Sequences," ACM Trans. Graphics, vol. 27, pp. 86:1-86:5, Aug. 2008.
[22] A. Rav-Acha, P. Kohli, C. Rother, and A. Fitzgibbon, "Unwrap Mosaics: A New Representation for Video Editing," ACM Trans. Graphics, vol. 27, no. 3, pp. 17:1-17:11, Aug. 2008.
[23] H. Pottmann, A. Asperl, M. Hofer, and A. Kilian, Architectural Geometry. Bentley Inst. of Press, 2007.
[24] T. Kelly and P. Wonka, "Interactive Architectural Modeling with Procedural Extrusions," ACM Trans. Graphics, vol. 30, no. 2, pp. 14:1-14:15, Apr. 2011.
[25] O. Aichholzer and F. Aurenhammer, "Straight Skeletons for General Polygonal Figures in the Plane," Proc. Second Ann. Int'l Computing and Combinatorics, pp. 117-126, 1996.
[26] C. Wu, S. Agarwal, B. Curless, and S.M. Seitz, "Schematic Surface Reconstruction," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2012.
[27] R. Schnabel, R. Wahl, and R. Klein, "Efficient Ransac for Point-Cloud Shape Detection," Computer Graphics Forum, vol. 26, no. 2, pp. 214-226, 2007.
[28] K. Yu, T. Zhang, and Y. Gong, "Nonlinear Learning Using Local Coordinate Coding," Proc. Conf. Advances in Neural Information Processing Systems, vol. 22, pp. 2223-2231, 2009.
[29] J. Peng, D. Kristjansson, and D. Zorin, "Interactive Modeling of Topologically Complex Geometric Detail," ACM Trans. Graphics, vol. 23, no. 3, pp. 635-643, Aug. 2004.
[30] C. Wu, J.-M. Frahm, and M. Pollefeys, "Detecting Large Repetitive Structures with Salient Boundaries," Proc. European Conf. Computer Vision, 2010.
[31] P. Zhao and L. Quan, "Translation Symmetry Detection in a Fronto-Parallel View," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011.
[32] O. Teboul, I. Kokkinos, L. Simon, P. Koutsourakis, and N. Paragios, "Shape Grammar Parsing via Reinforcement Learning," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011.
[33] P. Musialski, M. Wimmer, and P. Wonka, "Interactive Coherence-Based Facade Modeling," Computer Graphics Forum, vol. 31, no. 2, pp. 661-670, 2012.
[34] V. Kolmogorov and R. Zabin, "What Energy Functions can be Minimized via Graph Cuts?," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 2, pp. 147-159, Feb. 2004.
[35] S.D. Porumbescu, B. Budge, L. Feng, and K.I. Joy, "Shell Maps," ACM Trans. Graphics, vol. 24, no. 3, pp. 626-633, July 2005.
[36] M. Lhuillier and L. Quan, "A Quasi-Dense Approach to Surface Reconstruction from Uncalibrated Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 3, pp. 418-433, Mar. 2005.
[37] R.I. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, second ed. Cambridge Univ. Press, 2004.
[38] T. Fang and L. Quan, "Resampling Structure from Motion," Proc. European Conf. Computer Vision, 2010.
[39] P. Müller, P. Wonka, S. Haegler, A. Ulmer, and L.V. Gool, "Procedural Modeling of Buildings," ACM Trans. Graphics, vol. 25, no. 3, pp. 614-623, Aug. 2006.
[40] N. Tiilikainen, "A Comparative Study of Active Contour Snakes," Copenhagen University, Danmark, Tech. Rep., 2007.
146 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool