Issue No. 07 - July (2008 vol. 30)
We present a novel method for motion segmentation and depth ordering from a video sequence in general motion. We first compute motion segmentation based on differential properties of the spatio-temporal domain, and scale-space integration. Given a motion boundary, we describe two algorithms to determine depth ordering from two- and three- frame sequences. An remarkable characteristic of our method is its ability compute depth ordering from only two frames. The segmentation and depth ordering algorithms are shown to give good results on 6 real sequences taken in general motion. We use synthetic data to show robustness to high levels of noise and illumination changes; we also include cases where no intensity edge exists at the location of the motion boundary, or when no parametric motion model can describe the data. Finally, we describe human experiments showing that people, like our algorithm, can compute depth ordering from only two frames, even when the boundary between the layers is not visible in a single frame.
Image Processing and Computer Vision, Video analysis, Motion, Depth cues, Segmentation
Daphna Weinshall, Doron Feldman, "Motion Segmentation and Depth Ordering Using an Occlusion Detector", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 30, no. , pp. 1171-1185, July 2008, doi:10.1109/TPAMI.2007.70766