This Article 
 Bibliographic References 
 Add to: 
2011 10th IEEE International Symposium on Mixed and Augmented Reality
KinectFusion: Real-time dense surface mapping and tracking
Basel, Switzerland
October 26-October 29
ISBN: 978-1-4577-2183-0
Jamie Shotton, Microsoft Research
Steve Hodges, Microsoft Research Newcastle University
Pushmeet Kohi, Microsoft Research
Andrew J. Davison, Imperial College London
David Kim, Microsoft Research Newcastle University
David Molyneaux, Microsoft Research Lancaster University
Otmar Hilliges, Microsoft Research
Shahram Izadi, Microsoft Research
Richard A. Newcombe, Imperial College London
Andrew Fitzgibbon, Microsoft Research
We present a system for accurate real-time mapping of complex and arbitrary indoor scenes in variable lighting conditions, using only a moving low-cost depth camera and commodity graphics hardware. We fuse all of the depth data streamed from a Kinect sensor into a single global implicit surface model of the observed scene in real-time. The current sensor pose is simultaneously obtained by tracking the live depth frame relative to the global model using a coarse-to-fine iterative closest point (ICP) algorithm, which uses all of the observed depth data available. We demonstrate the advantages of tracking against the growing full surface model compared with frame-to-frame tracking, obtaining tracking and mapping results in constant time within room sized scenes with limited drift and high accuracy. We also show both qualitative and quantitative results relating to various aspects of our tracking and mapping system. Modelling of natural scenes, in real-time with only commodity sensor and GPU hardware, promises an exciting step forward in augmented reality (AR), in particular, it allows dense surfaces to be reconstructed in real-time, with a level of detail and robustness beyond any solution yet presented using passive computer vision.
Index Terms:
Surface reconstruction,Cameras,Image reconstruction,Real time systems,Simultaneous localization and mapping,Iterative closest point algorithm,Three dimensional displays,AR,Real-Time,Dense Reconstruction,Tracking,GPU,SLAM,Depth Cameras,Volumetric Representation
Jamie Shotton, Steve Hodges, Pushmeet Kohi, Andrew J. Davison, David Kim, David Molyneaux, Otmar Hilliges, Shahram Izadi, Richard A. Newcombe, Andrew Fitzgibbon, "KinectFusion: Real-time dense surface mapping and tracking," ismar, pp.127-136, 2011 10th IEEE International Symposium on Mixed and Augmented Reality, 2011
Usage of this product signifies your acceptance of the Terms of Use.