Issue No. 06 - June (2014 vol. 20)
Jan Herling , fayteq GmbH, Erfurt,
Wolfgang Broll , Virtual Worlds and Digtial Games group, Ilmenau University of Technology, Ilmenau, Germany
While image inpainting has recently become widely available in image manipulation tools, existing approaches to video inpainting typically do not even achieve interactive frame rates yet as they are highly computationally expensive. Further, they either apply severe restrictions on the movement of the camera or do not provide a high-quality coherent video stream. In this paper we will present our approach to high-quality real-time capable image and video inpainting. Our PixMix approach even allows for the manipulation of live video streams, providing the basis for real Diminished Reality (DR) applications. We will show how our approach generates coherent video streams dealing with quite heterogeneous background environments and non-trivial camera movements, even applying constraints in real-time.
Streaming media, Real-time systems, Visualization, Cameras, Coherence, Cost function, Image resolution
J. Herling and W. Broll, "High-Quality Real-Time Video Inpaintingwith PixMix," in IEEE Transactions on Visualization & Computer Graphics, vol. 20, no. 6, pp. 866-879, 2014.