The Community for Technology Leaders
Green Image
Issue No. 03 - May/June (2004 vol. 24)
ISSN: 0272-1716
pp: 52-63
Sing Bing Kang , Microsoft Research
Matthew Uyttendaele , Microsoft Research
Richard Szeliski , Microsoft Research
Richard Hartley , Australian National University and National ICT Australia
Simon Winder , Microsoft Research
Antonio Criminisi , Microsoft Research
ABSTRACT
This article describes an image-based acquisition and rendering system that enables users to explore remote real-world locations. The system is based on a lightweight, high-resolution, multisensor camera that can be used to quickly film a tour through a large environment such as a house or a garden. During the offline authoring phase, the raw video is processed to produce stabilized high-quality, high-dynamic-range video using a combination of novel techniques. These include a stitching algorithm to remove parallax in areas of image overlap, registration and blending algorithms to produce high dynamic range video from alternately exposed video frames, feature tracking to perform camera stabilization, and a video compression scheme that supports selective runtime decompression and random access. The final user experience is enhanced with multimedia elements such as overview maps, video textures, and sound.<p>The user controls the viewpoint and location through a standard game controller, and the resulting user experience feels much like a computer game. The combination of high-resolution, continuous imagery with real-time interactivity provides viewers with an unprecedented sense of presence in interesting real world environments.</p>
INDEX TERMS
CITATION
Sing Bing Kang, Matthew Uyttendaele, Richard Szeliski, Richard Hartley, Simon Winder, Antonio Criminisi, "Image-Based Interactive Exploration of Real-World Environments", IEEE Computer Graphics and Applications, vol. 24, no. , pp. 52-63, May/June 2004, doi:10.1109/MCG.2004.1297011
101 ms
(Ver 3.3 (11022016))