The Community for Technology Leaders
Green Image
Issue No. 06 - June (2014 vol. 20)
ISSN: 1077-2626
pp: 866-879
Jan Herling , fayteq GmbH, Erfurt,
Wolfgang Broll , Virtual Worlds and Digtial Games group, Ilmenau University of Technology, Ilmenau, Germany
ABSTRACT
While image inpainting has recently become widely available in image manipulation tools, existing approaches to video inpainting typically do not even achieve interactive frame rates yet as they are highly computationally expensive. Further, they either apply severe restrictions on the movement of the camera or do not provide a high-quality coherent video stream. In this paper we will present our approach to high-quality real-time capable image and video inpainting. Our PixMix approach even allows for the manipulation of live video streams, providing the basis for real Diminished Reality (DR) applications. We will show how our approach generates coherent video streams dealing with quite heterogeneous background environments and non-trivial camera movements, even applying constraints in real-time.
INDEX TERMS
Streaming media, Real-time systems, Visualization, Cameras, Coherence, Cost function, Image resolution
CITATION

J. Herling and W. Broll, "High-Quality Real-Time Video Inpaintingwith PixMix," in IEEE Transactions on Visualization & Computer Graphics, vol. 20, no. 6, pp. 866-879, 2014.
doi:10.1109/TVCG.2014.2298016
181 ms
(Ver 3.3 (11022016))