From the November 2014 issue

Depth Transfer: Depth Extraction from Video Using Non-Parametric Sampling

By Kevin Karsch, Ce Liu, and Sing Bing Kang

Featured article thumbnail imageWe describe a technique that automatically generates plausible depth maps from videos using non-parametric depth sampling. We demonstrate our technique in cases where past methods fail (non-translating cameras and dynamic scenes). Our technique is applicable to single images as well as videos. For videos, we use local motion cues to improve the inferred depth maps, while optical flow is used to ensure temporal depth consistency. For training and evaluation, we use a Kinect-based system to collect a large data set containing stereoscopic videos with known depths. We show that our depth estimation technique outperforms the state-of-the-art on benchmark databases. Our technique can be used to automatically convert a monoscopic video into stereo for 3D visualization, and we demonstrate this through a variety of visually pleasing results for indoor and outdoor scenes, including results from the feature film Charade .

download PDF View the PDF of this article      csdl View this issue in the digital library


Editorials and Announcements

Announcements

Editorials

Guest Editorials

Call for Papers

Reviewers List

Annual Index


Access recently published TPAMI articles

RSSSubscribe to the RSS feed of latest TPAMI content added to the digital library

Mail Sign up for the Transactions Connection newsletter.

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) is a scholarly archival journal published monthly. This journal covers traditional areas of computer vision and image understanding, all traditional areas of pattern analysis and recognition, and selected areas of machine intelligence.
Read the full scope of TPAMI