2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (2008)
Anchorage, AK, USA
June 23, 2008 to June 28, 2008
Biliana Kaneva , CSAIL, Massachusetts Institute of Technology, Cambridge, 02139, U.S.A.
Antonio Torralba , CSAIL, Massachusetts Institute of Technology, Cambridge, 02139, U.S.A.
Josef Sivic , INRIA, WILLOW Project, Laboratoire d'Informatique de l'Ecole Normale Superieure, Paris, France
William T. Freeman , CSAIL, Massachusetts Institute of Technology, Cambridge, 02139, U.S.A.
Shai Avidan , Adobe Research, Newton, MA, U.S.A.
We present a system for exploring large collections of photos in a virtual 3D space. Our system does not assume the photographs are of a single real 3D location, nor that they were taken at the same time. Instead, we organize the photos in themes, such as city streets or skylines, and let users navigate within each theme using intuitive 3D controls that include move left/right, zoom and rotate. Themes allow us to maintain a coherent semantic meaning of the tour, while visual similarity allows us to create a “being there” impression, as if the images were of a particular location. We present results on a collection of several million images downloaded from Flickr and broken into themes that consist of a few hundred thousand images each. A byproduct of our system is the ability to construct extremely long panoramas, as well as image taxi, a program that generates a virtual tour between a user supplied start and finish images. The system, and its underlying technology can be used in a variety of applications such as games, movies and online virtual 3D spaces like Second Life.
Biliana Kaneva, Antonio Torralba, Josef Sivic, William T. Freeman, Shai Avidan, "Creating and exploring a large photorealistic virtual space", 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, vol. 00, no. , pp. 1-8, 2008, doi:10.1109/CVPRW.2008.4562950