2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (2012)
Atlanta, GA, USA USA
Nov. 5, 2012 to Nov. 8, 2012
J. Herling , Ilmenau Univ. of Technol., Ilmenau, Germany
W. Broll , Ilmenau Univ. of Technol., Ilmenau, Germany
Diminished Reality (DR) allows to remove objects from a video stream while preseving a frame to frame coherence. Some approaches apply a pseudo-DR, allowing for the removal of objects only, while their background can be observed by a second camera. Most real DR approaches are highly computational expensive, not even allowing for interactive rates and/or apply significant restrictions regarding the uniformity of the background, or allow linear camera movements or even a static camera only. In this paper we will present a real-time capable Diminished Reality approach for high-quality image manipulation. Our approach achieves a significantly better performance and image quality for almost planar but non-trivial image backgrounds. Our Diminished Reality pipeline provides coherent video streams even for nonlinear camera movements due to the integration of homography based object tracking.
Streaming media, Real-time systems, Cameras, Coherence, Visualization, Cost function, Image segmentation
J. Herling and W. Broll, "PixMix: A real-time approach to high-quality Diminished Reality," 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Atlanta, GA, USA USA, 2013, pp. 141-150.