This Article 
 Bibliographic References 
 Add to: 
Independent Motion Detection in 3D Scenes
October 2000 (vol. 22 no. 10)
pp. 1191-1199

Abstract—This paper presents an algorithmic approach to the problem of detecting independently moving objects in 3D scenes that are viewed under camera motion. There are two fundamental constraints that can be exploited for the problem: 1) two/multiview camera motion constraint (for instance, the epipolar/trilinear constraint) and 2) shape constancy constraint. Previous approaches to the problem either use only partial constraints, or rely on dense correspondences or flow. We employ both the fundamental constraints in an algorithm that does not demand a priori availability of correspondences or flow. Our approach uses the plane-plus-parallax decomposition to enforce the two constraints. It is also demonstrated that for a class of scenes, called sparse 3D scenes in which genuine parallax and independent motions may be confounded, how the plane-plus-parallax decomposition allows progressive introduction, and verification of the fundamental constraints. Results of the algorithm on some difficult sparse 3D scenes are promising.

[1] G. Adiv, “Determining 3D Motion and Structure from Optical Flows Generated by Several Moving Objects,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 7, no. 4, pp. 384-401, Apr. 1985.
[2] J.R. Bergen, P. Anandan, K.J. Hanna, and R. Hingorani, “Hiercharchical Model-Based Motion Estimation,” Proc. European Conf. Computer Vision, pp. 237-252, 1992.
[3] S. Fejes and L.S. Davis, “What Can Projections of Flow Fields Tell us About the Visual Motion,” Proc. Int'l Conf. Computer Vision, pp. 979-986, 1998.
[4] K.J. Hanna and N.E. Okamoto, “Combining Stereo and Motion for Direct Estimation of Scene Structure,” Proc. Int'l Conf. Computer Vision, pp. 357-365, 1993.
[5] R. Hartley and R. Gupta, "Computing Matched-Epipolar Projections," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1993, pp. 549-555.
[6] M. Irani and P. Anandan, “A Unified Approach to Moving Object Detection in 2D and 3D Scenes,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 6, pp. 577-589, June 1998.
[7] R. Kumar, P. Anandan, and K. Hanna, “Direct Recovery of Shape from Multiple Views: A Parallax Based Approach,” Proc. Int'l Conf. Pattern Recognition, pp. 685-688, Oct. 1994.
[8] M.I.A. Lourakis, A.A. Argyros, and S.C. Orphanoudakis, “Independent 3D Motion Detection Using Residual Parallax Normal Flow Fields,” Proc. Int'l Conf. Computer Vision, pp. 1,012-1,017, 1998.
[9] B.D. Lucas and T. Kanade, “An Iterative Image Registration Technique with an Application to Stereo Vision,” Proc. Image Understanding Workshop, pp. 121-130, 1981.
[10] H.S. Sawhney, "3D Geometry From Planar Parallax," Proc. CVPR '94, pp. 929-934, 1994.
[11] H.S. Sawhney, S. Ayer, and M. Gorkani, “Model-Based 2D and 3D Dominant Motion Estimation for Mosaicing and Video Representation,” Proc. Fifth Int'l Conf. Computer Vision, pp. 583-590, June 1995.
[12] A. Shashua, “Algebraic Functions for Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 8, pp. 779-789, 1995.
[13] A. Shashua and N. Navab, "Relative Affine Structure: Theory and Application to 3D Reconstruction From Perspective Views," Proc. CVPR '94, pp. 483-489, 1994.
[14] G.P. Stein and A. Shashua, “Model-Based Brightness Constraints: On Direct Estimation of Structure and Motion,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 400-406, 1997.
[15] P.H.S. Torr, “Geometric Motion Segmentation and Model Selection,” Philosophical Trans. Royal Soc. A, pp. 1,321-1,340, 1998.
[16] P.H.S. Torr, A. Zisserman, and S. Maybank, “Robust Detection of Degenerate Configurations for the Fundamental Matrix,” Computer Vision and Image Understanding, vol. 71, no. 3, pp. 312-333, 1998.
[17] Z. Zhang, R. Deriche, O. Faugeras, and Q.T. Luong, “A Rubust Technique for Matching Two Uncalibrated Images through the Recovery of the Unknown Epipolar Geometry,” Artificial Intelligence J., vol. 78, pp. 87-119, 1995.

Index Terms:
Motion analysis, 3D scene analysis, moving object detection, dynamic 3D analysis.
Harpreet S. Sawhney, Yanlin Guo, Rakesh Kumar, "Independent Motion Detection in 3D Scenes," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 10, pp. 1191-1199, Oct. 2000, doi:10.1109/34.879803
Usage of this product signifies your acceptance of the Terms of Use.