This Article 
 Bibliographic References 
 Add to: 
Recovering 3D Motion of Multiple Objects Using Adaptive Hough Transform
October 1997 (vol. 19 no. 10)
pp. 1178-1183

Abstract—We present a method to determine 3D motion and structure of multiple objects from two perspective views, using adaptive Hough transform. In our method, segmentation is determined based on a 3D rigidity constraint. Instead of searching candidate solutions over the entire five-dimensional translation and rotation parameter space, we only examine the two-dimensional translation space. We divide the input image into overlapping patches, and, for each sample of the translation space, we compute the rotation parameters of patches using least-squares fit. Every patch votes for a sample in the five-dimensional parameter space. For a patch containing multiple motions, we use a redescending M-estimator to compute rotation parameters of a dominant motion within the patch. To reduce computational and storage burdens of standard multidimensional Hough transform, we use adaptive Hough transform to iteratively refine the relevant parameter space in a "coarse-to-fine" fashion. Our method can robustly recover 3D motion parameters, reject outliers of the flow estimates, and deal with multiple moving objects present in the scene. Applications of the proposed method to both synthetic and real image sequences are demonstrated with promising results.

[1] G. Adiv, "Determining Three-Dimensional Motion and Structure from Optical Flow Generated by Several Moving Objects," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 7, pp. 384-401, 1985.
[2] S. Ayer, P. Schroeter, and J. Bigun, "Segmentation of Moving Objects by Robust Motion Parameter Estimation over Multiple Frames," ECCV, pp. 316-327, 1994.
[3] D. Ballard and O. Kimball, "Rigid Body Motion from Depth and Optical Flow," Computer Visualization, Graphics, and Image Processing, vol. 22, pp. 95-115, 1983.
[4] M.J. Black and Y. Yacoob, "Tracking and Recognizing Rigid and Non-Rigid Facial Motions Using Local Parametric Model of Image Motion," Proc. Int'l Conf. Computer Vision, pp. 374-381,Cambridge, Mass., 1995.
[5] M. Bober and J. Kittler, "Estimation of Complex Multimodal Motion: An Approach Based on Robust Statistics and Hough transform," Image and Vision Computing, vol. 12, pp. 661-668, 1994.
[6] J. Costeira and T. Kanade, "A Multi-Body Factorization Method for Motion Analysis," Int'l Conf. Computer Vision, pp. 1,071-1,076,Cambridge, Mass., June 1995.
[7] W.C. Gear, "Feature Grouping in Moving Objects," IEEE Workshop on Non-Rigid and Articulate Motion, 1994.
[8] F. Hampel, E. Ronchetti, P. Rousseeuw, and W. Stahel, Robust Statistics: An Approach Based on Influence Function.New York: Wiley, 1986.
[9] D. Heeger and A. Jepson, "Subspace Methods for Recovering Rigid Motion I: Algorithm and Implementation," Int'l J. Computer Visualization, vol. 7, pp. 95-117, 1992.
[10] P. Holland and R. Welsch, "Robust Regression Using Iteratively Reweighted Least Squares," Comm. Statistics—Theoretical Method, pp. 813-827, 1977.
[11] J. Illingworth and J. Kittler, "Adaptive Hough transform," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, pp. 690-698, 1987.
[12] M. Irani, B. Rousso, and S. Peleg, "Detecting and Tracking Multiple Moving Objects Using Temporal Integration," ECCV, pp. 282-287, 1992.
[13] A.D. Jepson and D.J. Heeger, "Linear Subspace Methods for Recovering Translation Direction," Spatial Vision in Humans and Robots, L. Harris and M. Jenkin, eds., pp. 39-62.New York: Cambridge Univ. Press, 1993.
[14] R. Lumia, L. Shapiro, and O. Zuniga, "A New Connected Component Algorithm for Virtual Memory Computers," Computer Visualization, Graphics, and Image Processing, vol. 22, pp. 287-300, 1983.
[15] H.C. Longuet-Higgens and K. Prazdny, "The Interpretation of a Moving Retinal Image," Proc. Royal Soc. of London, B 208, 1980.
[16] W.J. MacLean, A.D. Jepson, and R.C. Frecker, "Recovery of Egomotion and Segmentation of Independent Object Motion USING the EM Algorithm," Proc. British Machine Vision Conf., pp. 13-16,York, U.K., 1994.
[17] W.B. Thompson, P. Lechleider, and E.R. Stuck, "Detectng Moving Objects Using the Rigidity Constraint," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 2, Feb. 1993.
[18] W. Thompson, K. Mutch, and V. Berzins, "Dynamic Occlusion Analysis in Optical Flow Fields," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 7, pp. 374-383, 1985.
[19] C. Tomasi and T. Kanade, "Detection and Tracking of Point Features, Shape and Motion from Image Streams: A Factorization Method—Part 3," Technical Report CMU-CS-91-132, Carnegie Mellon Univ., 1991.
[20] C. Tomasi and T. Kanade, "Shape from Motion from Image Streams under Orthography: A Factorization Method," Int'l J. Computer Visualization, vol. 9, pp. 137-154, 1992.
[21] P. Torr and D. Murray, "Stochastic Motion Clustering," ECCV, pp. 328-337, 1994.
[22] J.Y.A. Wang and E. Adelson, "Layered Representation for Motion Analysis," Proc. Computer Vision and Pattern Recognition Conf., 1993.
[23] J. Weng,T. Huang,, and N. Ahuja,“Motion and structure from two perspective views:Algorithms, error analysis and error estimation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 5, pp. 451-476, May 1989.

Index Terms:
Multiple-motion analysis, segmentation, structure-from-motion, robust estimation, adaptive Hough transform.
Tina Yu Tian, Mubarak Shah, "Recovering 3D Motion of Multiple Objects Using Adaptive Hough Transform," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 10, pp. 1178-1183, Oct. 1997, doi:10.1109/34.625131
Usage of this product signifies your acceptance of the Terms of Use.