Issue No. 09 - September (2010 vol. 32)
Arnold W.M. Smeulders , University of Amsterdam, Amsterdam
Jan-Mark Geusebroek , University of Amsterdam, Amsterdam
André Redert , Philips Research Laboratories Eindhoven, Eindhoven
Vladimir Nedović , University of Amsterdam, Amsterdam
Reconstruction of 3D scene geometry is an important element for scene understanding, autonomous vehicle and robot navigation, image retrieval, and 3D television. We propose accounting for the inherent structure of the visual world when trying to solve the scene reconstruction problem. Consequently, we identify geometric scene categorization as the first step toward robust and efficient depth estimation from single images. We introduce 15 typical 3D scene geometries called stages, each with a unique depth profile, which roughly correspond to a large majority of broadcast video frames. Stage information serves as a first approximation of global depth, narrowing down the search space in depth estimation and object localization. We propose different sets of low-level features for depth estimation, and perform stage classification on two diverse data sets of television broadcasts. Classification results demonstrate that stages can often be efficiently learned from low-dimensional image representations.
Scene geometry, scene structure, depth estimation, scene categorization, stages.
Arnold W.M. Smeulders, Jan-Mark Geusebroek, André Redert, Vladimir Nedović, "Stages as Models of Scene Geometry", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 32, no. , pp. 1673-1687, September 2010, doi:10.1109/TPAMI.2009.174