This Article 
 Bibliographic References 
 Add to: 
Immersive 3D Telepresence
July 2014 (vol. 47 no. 7)
pp. 46-52
Henry Fuchs, University of North Carolina at Chapel Hill
Andrei State, University of North Carolina at Chapel Hill
Jean-Charles Bazin, ETH Zürich
Cutting-edge work on 3D telepresence at a multinational research center provides insight into the technology's potential, as well as into its remaining challenges. The first Web extra at is a video describing FreeCam, a system capable of generating live free-viewpoint video by simulating the output of a virtual camera moving through a dynamic scene. The second Web extra at is a video showing a system designed to capture the enhanced 3D structure of a room-sized dynamic scene with commodity depth cameras, such as Microsoft Kinects. The third Web extra at is a video demonstrating a system that adapts to a wide variety of telepresence scenarios. By combining Kinect-based 3D scanning with optical see-through HMDs, the user can precisely control which parts of the scene are real and which are virtual or remote objects. The fourth Web extra at is a video demonstrating a method based on moving least squares surfaces that robustly and efficiently reconstructs dynamic scenes captured by a set of hybrid color+depth cameras. The reconstruction provides spatiotemporal consistency and seamlessly fuses color and geometric information. The video also illustrates the formulation on a variety of real sequences and demonstrates that it favorably compares to state-of-the-art methods. The fifth Web extra at is a video demonstrating a 3D acquisition system capable of simultaneously capturing an entire room-sized volume with an array of commodity depth cameras and rendering it from a novel viewpoint in real time. The sixth Web extra at is a video demonstrating a gaze-correction approach based on a single Kinect sensor that preserves both the integrity and expressiveness of the face as well as the fidelity of the scene as a whole, producing nearly artifact-free imagery. The method is suitable for mainstream home video conferencing: it uses inexpensive consumer hardware, achieves real-time performance, and requires just a simple and short setup.
Index Terms:
Three-dimensional displays,Cameras,Image reconstruction,Real-time systems,Stereo image processing,Glass,Solid modeling,BeingThere Centre,3D telepresence,3D acquisition,3D reconstruction,3D display,computer vision,graphics,visualization,augmented reality
Henry Fuchs, Andrei State, Jean-Charles Bazin, "Immersive 3D Telepresence," Computer, vol. 47, no. 7, pp. 46-52, July 2014, doi:10.1109/MC.2014.185
Usage of this product signifies your acceptance of the Terms of Use.