Issue No. 04 - July/August (2007 vol. 13)
Mingxuan Sun , IEEE
Ruigang Yang , IEEE
Huamin Wang , IEEE Computer Society
<p><b>Abstract</b>—In this paper, we propose a novel framework called <it>space-time light field rendering</it>, which allows <it>continuous</it> exploration of a dynamic scene in both space and time. Compared to existing light field capture/rendering systems, it offers the capability of using <it>unsynchronized</it> video inputs and the added freedom of controlling the visualization in the temporal domain, such as smooth slow motion and temporal integration. In order to synthesize novel views from any viewpoint at any time instant, we develop a two-stage rendering algorithm. We first interpolate in the temporal domain to generate globally synchronized images using a robust spatial-temporal image registration algorithm followed by edge-preserving image morphing. We then interpolate these software-synchronized images in the spatial domain to synthesize the final view. In addition, we introduce a very accurate and robust algorithm to estimate subframe temporal offsets among input video sequences. Experimental results from unsynchronized videos with or without time stamps show that our approach is capable of maintaining photorealistic quality from a variety of real scenes.</p>
Image-based rendering, space-time light field, epipolar constraint, image morphing.
Mingxuan Sun, Ruigang Yang, Huamin Wang, "Space-Time Light Field Rendering", IEEE Transactions on Visualization & Computer Graphics, vol. 13, no. , pp. 697-710, July/August 2007, doi:10.1109/TVCG.2007.1019