Issue No. 05 - May (2006 vol. 28)
Yu-Wing Tai , IEEE Computer Society
Tai-Pang Wu , IEEE Computer Society
Jiaya Jia , IEEE Computer Society
Chi-Keung Tang , IEEE Computer Society
This paper presents a complete system capable of synthesizing a large number of pixels that are missing due to occlusion or damage in an uncalibrated input video. These missing pixels may correspond to the static background or cyclic motions of the captured scene. Our system employs user-assisted video layer segmentation, while the main processing in video repair is fully automatic. The input video is first decomposed into the color and illumination videos. The necessary temporal consistency is maintained by tensor voting in the spatio-temporal domain. Missing colors and illumination of the background are synthesized by applying image repairing. Finally, the occluded motions are inferred by spatio-temporal alignment of collected samples at multiple scales. We experimented on our system with some difficult examples with variable illumination, where the capturing camera can be stationary or in motion.
Video restoration, spatio-temporal consistence, illumination consistence, tensor voting, applications.
Yu-Wing Tai, Tai-Pang Wu, Jiaya Jia, Chi-Keung Tang, "Video Repairing under Variable Illumination Using Cyclic Motions", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 28, no. , pp. 832-839, May 2006, doi:10.1109/TPAMI.2006.108